Hugging Face's logo

aberry273
/
Instruct-PTBR-ENUS-11M

Summarization
Transformers
Safetensors
mt5
text2text-generation
Generated from Trainer
Inference Endpoints
Model card Files Community
Instruct-PTBR-ENUS-11M / README.md
aberry273's picture
aberry273
Training complete
4f4f3ec verified
preview code
|
raw
history blame contribute delete
1.33 kB
metadata
license: apache-2.0
base_model: google/mt5-small
tags:
  - summarization
  - generated_from_trainer
model-index:
  - name: Instruct-PTBR-ENUS-11M
    results: []

Instruct-PTBR-ENUS-11M

This model is a fine-tuned version of google/mt5-small on an unknown dataset. It achieves the following results on the evaluation set:

  • eval_loss: 20.5681
  • eval_rouge1: 2.8676
  • eval_rouge2: 0.8599
  • eval_rougeL: 2.7183
  • eval_rougeLsum: 2.7447
  • eval_runtime: 80.5817
  • eval_samples_per_second: 31.024
  • eval_steps_per_second: 3.884
  • step: 0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5.6e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 8

Framework versions

  • Transformers 4.36.2
  • Pytorch 1.10.1+cu113
  • Datasets 2.16.1
  • Tokenizers 0.15.0