--- license: apache-2.0 base_model: facebook/bart-base tags: - generated_from_trainer metrics: - rouge model-index: - name: bart-base-finetuned-cnn_dailymail results: [] --- # bart-base-finetuned-cnn_dailymail This model is a fine-tuned version of [facebook/bart-base](https://huggingface.co./facebook/bart-base) on the None dataset. It achieves the following results on the evaluation set: - Loss: 1.0869 - Rouge1: 24.319 - Rouge2: 11.7165 - Rougel: 20.2787 - Rougelsum: 22.8328 - Bleu 1: 4.2345 - Bleu 2: 2.7623 - Bleu 3: 2.0117 - Meteor: 12.0461 - Compression rate: 4.0559 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5.6e-05 - train_batch_size: 16 - eval_batch_size: 128 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 2 ### Training results | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Bleu 1 | Bleu 2 | Bleu 3 | Meteor | Compression rate | |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:------:|:------:|:------:|:-------:|:----------------:| | 1.4958 | 1.0 | 625 | 1.1055 | 24.2121 | 11.6998 | 20.2626 | 22.6715 | 4.2072 | 2.7283 | 1.981 | 11.9736 | 4.0611 | | 1.1078 | 2.0 | 1250 | 1.0869 | 24.319 | 11.7165 | 20.2787 | 22.8328 | 4.2345 | 2.7623 | 2.0117 | 12.0461 | 4.0559 | ### Framework versions - Transformers 4.40.0 - Pytorch 2.2.2+cu118 - Datasets 2.19.0 - Tokenizers 0.19.1