Collection of Arabic Tokenizers with different sizes based on SentencePiece & PBE Encodings suitable for training LLMs
Robotics and Interne-of-Things
riotu-lab
AI & ML interests
None yet
Organizations
None yet
models
19
riotu-lab/ArabianGPT-1.5B-FT-SA-v2
Updated
•
5
riotu-lab/Aranizer-PBE-64k
Updated
•
1
riotu-lab/Aranizer-SP-32k
Updated
riotu-lab/Aranizer-SP-64k
Updated
riotu-lab/Aranizer-SP-86k
Updated
riotu-lab/Aranizer-PBE-32k
Updated
•
1
riotu-lab/Aranizer-PBE-86k
Updated
riotu-lab/ArabianGPT-0.8B-Sum-FT
Updated
•
4
riotu-lab/ArabianGPT-0.8B-FT-QA
Updated
•
28
riotu-lab/ArabianGPT1.5B-QA-FT
Text Generation
•
Updated
•
12
•
1
datasets
5
riotu-lab/ARABIC-RAW-TEXT
Viewer
•
Updated
•
100M
•
138
•
1
riotu-lab/ArabicQA_2.1M
Viewer
•
Updated
•
2.14M
•
3
•
2
riotu-lab/Arabic-books-and-research-dataset
Viewer
•
Updated
•
37k
•
2
•
1
riotu-lab/Synthetic-UAV-Flight-Trajectories
Viewer
•
Updated
•
766k
•
2
riotu-lab/Quran-Tafseers
Viewer
•
Updated
•
56.1k
•
4
•
5