Hugging Face's logo

JoseLuis95
/
mbart-EN-ADV-ELE

Text2Text Generation
Transformers
Safetensors
mbart
simplification
Generated from Trainer
Inference Endpoints
Model card Files Community
mbart-EN-ADV-ELE / README.md
JoseLuis95's picture
JoseLuis95
Update README.md
82c12a1 verified
preview code
|
raw
history blame contribute delete
1.62 kB
metadata
license: mit
base_model: facebook/mbart-large-50
tags:
  - simplification
  - generated_from_trainer
metrics:
  - bleu
model-index:
  - name: mbart-EN-ADV-ELE
    results: []

mbart-EN-ADV-ELE

This model is a fine-tuned version of facebook/mbart-large-50 on JoseLuis95/adv-ele. It achieves the following results on the evaluation set:

  • Loss: 0.3152
  • Bleu: 88.5796
  • Gen Len: 28.9055

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5.6e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 3

Training results

Training Loss Epoch Step Validation Loss Bleu Gen Len
No log 1.0 217 0.3728 78.6166 28.4931
No log 2.0 434 0.2928 86.434 28.6659
0.4772 3.0 651 0.3152 88.5796 28.9055

Framework versions

  • Transformers 4.38.1
  • Pytorch 2.1.0+cu121
  • Datasets 2.17.1
  • Tokenizers 0.15.2