metadata

language:
  - kk
  - en
  - ru
license: mit
tags:
  - gpt3
  - transformers
  - mgpt

🇰🇿 Kazakh mGPT 1.3B

Language model for Kazakh. Model has 1.3B parameters as you can guess from it's name.

Kazakh belongs to Turkic language family. It's a very vibrant language with approximately 18 million speakers. Here are some facts about it:

It is a major language spoken in Kazakhstan.
Kazakh has its own version of the Cyrillic script but is transitioning to the Latin script.
It has a rich tradition of oral literature, including epic poetry.

Dataset

TBD

TBD

Try different generation strategies to reach better results.

TBD

Model will be improved over time. Stay tuned!