aoxo
/

Ma-layala-mba_Tiny_128M

Text Generation

state space models

Inference Endpoints

Model card Files Files and versions Community

aoxo commited on Aug 18

Commit

36f6eba

•

1 Parent(s): 61895fb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -24,7 +24,7 @@ Welcome to Ma-layala-mba, a base Indic language model designed to push the bound
 Ma-layala-mba is a state-of-the-art S6 SSM model specifically crafted for the South Indian regional and state language of Kerala: Malayalam. It integrates traditional Attention mechanisms with innovative approaches such as MLPs and State Space Models (SSMs) to handle complex linguistic features and achieve high accuracy in language understanding and generation.
-- **Model Type**: Mamba model with Attention, MLP, and SSMs components.
 - **Language(s)**: Malayalam
 - **License**: GNU General Public License v3.0
 - **Training Precision**: bfloat16

 Ma-layala-mba is a state-of-the-art S6 SSM model specifically crafted for the South Indian regional and state language of Kerala: Malayalam. It integrates traditional Attention mechanisms with innovative approaches such as MLPs and State Space Models (SSMs) to handle complex linguistic features and achieve high accuracy in language understanding and generation.
+- **Model Type**: A 128M Jamba model finetuned on ~1.5M samples of Malayalam prompt-response pairs from a subset of the IndicCorop Dataset
 - **Language(s)**: Malayalam
 - **License**: GNU General Public License v3.0
 - **Training Precision**: bfloat16