lgaalves
/

gpt1

Text Generation

Inference Endpoints

Model card Files Files and versions Community

gpt1 / tokenizer_config.json

lgaalves's picture

Upload tokenizer

4c79252 about 1 year ago

history blame contribute delete

137 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}