training completed[prod]: 512 128

README.md

@@ -1,13 +1,9 @@
 ---
 tags:
 - generated_from_trainer
-metrics:
-- rouge
 model-index:
 - name: pegasus-legalease
   results: []
-datasets:
-- hheiden/us-congress-117-bills
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -17,12 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model was trained from scratch on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.2373
-- Rouge1: 0.4847
-- Rouge2: 0.3225
-- Rougel: 0.4194
-- Rougelsum: 0.4177
-- Gen Len: 43.02
+- Loss: 1.1142
 
 ## Model description
 
@@ -42,28 +33,34 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 5
+- num_epochs: 1
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
-|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
-| 5.2738        | 1.0   | 125  | 4.6004          | 0.4363 | 0.2769 | 0.375  | 0.3743    | 37.24   |
-| 4.8164        | 2.0   | 250  | 4.4350          | 0.464  | 0.3085 | 0.405  | 0.4038    | 40.3    |
-| 4.8494        | 3.0   | 375  | 4.3372          | 0.473  | 0.3153 | 0.412  | 0.41      | 41.2    |
-| 4.6062        | 4.0   | 500  | 4.2669          | 0.4791 | 0.3196 | 0.4159 | 0.4141    | 43.03   |
-| 4.5682        | 5.0   | 625  | 4.2373          | 0.4847 | 0.3225 | 0.4194 | 0.4177    | 43.02   |
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 0.09  | 250  | 4.5607          |
+| 4.8769        | 0.18  | 500  | 4.2187          |
+| 4.8769        | 0.27  | 750  | 2.2905          |
+| 2.9804        | 0.35  | 1000 | 1.1894          |
+| 2.9804        | 0.44  | 1250 | 1.1604          |
+| 1.3716        | 0.53  | 1500 | 1.1433          |
+| 1.3716        | 0.62  | 1750 | 1.1318          |
+| 1.2964        | 0.71  | 2000 | 1.1244          |
+| 1.2964        | 0.8   | 2250 | 1.1188          |
+| 1.248         | 0.89  | 2500 | 1.1152          |
+| 1.248         | 0.98  | 2750 | 1.1142          |
 
 
 ### Framework versions
 
-- Transformers 4.38.1
+- Transformers 4.38.2
 - Pytorch 2.1.0+cu121
 - Datasets 2.18.0
-- Tokenizers 0.15.2
+- Tokenizers 0.15.2

generation_config.json

@@ -1,4 +1,5 @@
 {
+  "_from_model_config": true,
   "bos_token_id": 0,
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
@@ -7,5 +8,5 @@
   "max_length": 64,
   "num_beams": 8,
   "pad_token_id": 0,
-  "transformers_version": "4.38.1"
+  "transformers_version": "4.38.2"
 }

runs/Mar08_22-44-37_e6ae31d0efb2/events.out.tfevents.1709937880.e6ae31d0efb2.13111.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2e50a974647b7bf85e0330d5d24d20be4a2b8c63078539448d5883af01721976
-size 8586
+oid sha256:f6ca1c453ac5133258515bc45fde7291daf87afb37b3124a8248b96a6008aa6c
+size 9964