Commit
•
9b13275
1
Parent(s):
515814a
Upload tokenizer
Browse files- vocab.json +1 -1
vocab.json
CHANGED
|
@@ -1,10 +1,10 @@
|
|
| 1 |
{
|
| 2 |
-
" ": 5,
|
| 3 |
"[CLS]": 2,
|
| 4 |
"[MASK]": 4,
|
| 5 |
"[PAD]": 0,
|
| 6 |
"[SEP]": 3,
|
| 7 |
"[UNK]": 1,
|
|
|
|
| 8 |
"ء": 6,
|
| 9 |
"آ": 7,
|
| 10 |
"أ": 8,
|
|
|
|
| 1 |
{
|
|
|
|
| 2 |
"[CLS]": 2,
|
| 3 |
"[MASK]": 4,
|
| 4 |
"[PAD]": 0,
|
| 5 |
"[SEP]": 3,
|
| 6 |
"[UNK]": 1,
|
| 7 |
+
"|": 5,
|
| 8 |
"ء": 6,
|
| 9 |
"آ": 7,
|
| 10 |
"أ": 8,
|