|
--- |
|
license: mit |
|
language: |
|
- fr |
|
base_model: |
|
- google/gemma-2-2b-it |
|
pipeline_tag: translation |
|
--- |
|
|
|
# Model Card for Model ID |
|
|
|
kAIra-gemma-2-2b is a finetuned version of google/gemma-2-2b-it can be used in French to translate any text into a slang version of it. |
|
|
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
|
|
|
|
- **Developed by:** Sébastien Fischman |
|
- **Funded by [optional]:** None |
|
- **Shared by [optional]:** Sébastien Fischman |
|
- **Model type:** [More Information Needed] |
|
- **Language(s) (NLP):** French |
|
- **License:** MIT |
|
- **Finetuned from model [optional]:** google/gemma-2-2b-it |
|
|
|
### Model Sources [optional] |
|
|
|
<!-- Provide the basic links for the model. --> |
|
|
|
- **Repository:** https://www.kaggle.com/code/optimo/kaira-adapting-gemma2-to-local-slang-french/ |
|
|
|
## Uses |
|
|
|
This model is a toy example to showcase how to teach an LLM French slang, it can be used to generate funny translation in argot. |
|
|
|
|
|
## Bias, Risks, and Limitations |
|
|
|
|
|
Since the model is trained to translate in slang, some generated content can be considered offensive or inappropriate. |
|
|
|
### Recommendations |
|
|
|
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. --> |
|
|
|
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. |
|
|
|
## How to Get Started with the Model |
|
|
|
Use the code from Kaggle here : https://www.kaggle.com/code/optimo/kaira-adapting-gemma2-to-local-slang-french/ |
|
Or use the HF Space: Coming |
|
|
|
[More Information Needed] |
|
|
|
## Training Details |
|
|
|
### Training Data |
|
|
|
https://www.kaggle.com/datasets/optimo/french-kaira-training |
|
|
|
|
|
### Training Procedure |
|
|
|
Training code is fully accesible here: https://www.kaggle.com/code/optimo/kaira-adapting-gemma2-to-local-slang-french/ |
|
|
|
|
|
#### Training Hyperparameters |
|
|
|
- **Training regime:** bf16 |
|
|
|
[More Information Needed] |
|
### Framework versions |
|
|
|
- PEFT 0.14.0 |
