metadata

language:
  - ro
  - en
  - ru
license: mit
tags:
  - gpt3
  - transformers
  - mgpt

🇷🇴 Romanian mGPT 1.3B

Language model for Romanian. Model has 1.3B parameters as you can guess from it's name.

Romanian belongs to Indo-European language family. It's a very lyrical language with approximately 24 million speakers. Here are some facts about it:

It is a Romance language, closely related to Italian, French, Spanish, Portuguese, and Catalan.
It retains several Latin characteristics, making it unique among the Romance languages.
While primarily spoken in Romania and Moldova, there are also Romanian speakers in neighboring countries and diaspora communities worldwide.

Dataset

TBD

TBD

Try different generation strategies to reach better results.

TBD

Model will be improved over time. Stay tuned!