nlpodyssey
/

rwkv-4-pile-3b-instruct

Inference Endpoints

Model card Files Files and versions Community

rwkv-4-pile-3b-instruct / config.json

mgrella's picture

RWKV-4-Pile-3B-Instruct-test1-20230124

0f57b1d about 2 years ago

history blame contribute delete

131 Bytes

	{
	"d_model": 2560,
	"num_hidden_layers": 32,
	"rescale_layer": 6,
	"vocab_size": 50277,
	"embeddings_store_name": "tokens"
	}