Hugging Face's logo

suchirsalhan
/
FR-CamWikiTokenizer

Model card Files Community
suchirsalhan commited on
Commit
c19b8a9
•
1 Parent(s): 9edc7b7

Update tokenizer_config.json

Browse files
Files changed (1) hide show
  1. tokenizer_config.json +1 -1
tokenizer_config.json CHANGED
@@ -13,7 +13,7 @@
13
  "single_word": false
14
  },
15
  "model_max_length": 1000000000000000019884624838656,
16
- "name_or_path": "suchirsalhan/ZH-CamBabyTokeniser-BabyBERTa",
17
  "pad_token": "<pad>",
18
  "sep_token": "</s>",
19
  "special_tokens_map_file": null,
 
13
  "single_word": false
14
  },
15
  "model_max_length": 1000000000000000019884624838656,
16
+ "name_or_path": "suchirsalhan/FR-CamWikiTokenizer",
17
  "pad_token": "<pad>",
18
  "sep_token": "</s>",
19
  "special_tokens_map_file": null,