fukugawa
/

transformer-lm-japanese-1.0b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

transformer-lm-japanese-1.0b / added_tokens.json

fukugawa's picture

Upload tokenizer

d831d9c verified about 2 months ago

76 Bytes

	{
	"<pad>": 30002,
	"[CLS]": 30000,
	"[MASK]": 30003,
	"[SEP]": 30001
	}