Text2Text Generation
Transformers
PyTorch
English
Kinyarwanda
m2m_100
Inference Endpoints
Kleber's picture
Update README.md
f7e5fae
|
raw
history blame
2.17 kB
metadata
license: cc-by-2.0
datasets:
  - mbazaNLP/NMT_Tourism_parallel_data_en_kin
  - mbazaNLP/NMT_Education_parallel_data_en_kin
  - mbazaNLP/Kinyarwanda_English_parallel_dataset
language:
  - en
  - rw
library_name: transformers

Model Details

Model Description

This is a Machine Translation model, finetuned from NLLB-200's distilled 1.3B model, it is meant to be used in machine translation for tourism-related data.

  • Finetuning code repository: the code used to finetune this model can be found here

How to Get Started with the Model

Use the code below to get started with the model.

Training Procedure

The model was finetuned on three datasets; a general purpose dataset, a tourism, and an education dataset.

The model was finetuned in two phases.

Phase one:

  • General purpose dataset
  • Education dataset
  • Tourism dataset

Phase two:

  • Tourism dataset

Other than the dataset changes between phase one, and phase two finetuning; no other hyperparameters were modified. In both cases, the model was trained on an A100 40GB GPU for two epochs.

Evaluation

Testing Data

Metrics

Model performance was measured using BLEU, spBLEU, TER, and chrF++ metrics.

Results

Lang. Direction BLEU spBLEU chrf++ TER
Eng -> Kin 28.37 40.62 56.48 59.71
Kin -> Eng 42.54 44.84 61.54 43.87