mixtralyanis
commited on
Commit
•
cf4eb16
1
Parent(s):
d487725
End of training
Browse files- README.md +78 -53
- model.safetensors +1 -1
- runs/Feb24_13-43-15_a191c644522c/events.out.tfevents.1708782200.a191c644522c.2522.1 +3 -0
- runs/Feb24_13-45-18_a191c644522c/events.out.tfevents.1708782322.a191c644522c.2522.2 +3 -0
- runs/Feb24_13-47-25_a191c644522c/events.out.tfevents.1708782446.a191c644522c.23281.0 +3 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
15 |
|
16 |
This model is a fine-tuned version of [facebook/bart-large-cnn](https://huggingface.co/facebook/bart-large-cnn) on the None dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
-
- Loss: 0.
|
19 |
|
20 |
## Model description
|
21 |
|
@@ -34,7 +34,7 @@ More information needed
|
|
34 |
### Training hyperparameters
|
35 |
|
36 |
The following hyperparameters were used during training:
|
37 |
-
- learning_rate:
|
38 |
- train_batch_size: 4
|
39 |
- eval_batch_size: 4
|
40 |
- seed: 42
|
@@ -42,63 +42,88 @@ The following hyperparameters were used during training:
|
|
42 |
- total_train_batch_size: 64
|
43 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
44 |
- lr_scheduler_type: linear
|
45 |
-
- lr_scheduler_warmup_steps:
|
46 |
-
- num_epochs:
|
47 |
|
48 |
### Training results
|
49 |
|
50 |
| Training Loss | Epoch | Step | Validation Loss |
|
51 |
|:-------------:|:-----:|:----:|:---------------:|
|
52 |
| 9.4233 | 0.17 | 1 | 9.1990 |
|
53 |
-
| 9.5213 | 0.34 | 2 | 8.
|
54 |
-
|
|
55 |
-
| 8.
|
56 |
-
|
|
57 |
-
|
|
58 |
-
|
|
59 |
-
|
|
60 |
-
|
|
61 |
-
|
|
62 |
-
|
|
63 |
-
|
|
64 |
-
|
|
65 |
-
|
|
66 |
-
|
|
67 |
-
|
|
68 |
-
|
|
69 |
-
|
|
70 |
-
|
|
71 |
-
|
|
72 |
-
|
|
73 |
-
|
|
74 |
-
|
|
75 |
-
|
|
76 |
-
|
|
77 |
-
|
|
78 |
-
|
|
79 |
-
|
|
80 |
-
|
|
81 |
-
|
|
82 |
-
|
|
83 |
-
|
|
84 |
-
|
|
85 |
-
|
|
86 |
-
|
|
87 |
-
|
|
88 |
-
|
|
89 |
-
|
|
90 |
-
|
|
91 |
-
|
|
92 |
-
|
|
93 |
-
|
|
94 |
-
|
|
95 |
-
|
|
96 |
-
|
|
97 |
-
|
|
98 |
-
|
|
99 |
-
|
|
100 |
-
|
|
101 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
102 |
|
103 |
|
104 |
### Framework versions
|
|
|
15 |
|
16 |
This model is a fine-tuned version of [facebook/bart-large-cnn](https://huggingface.co/facebook/bart-large-cnn) on the None dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
+
- Loss: 0.0236
|
19 |
|
20 |
## Model description
|
21 |
|
|
|
34 |
### Training hyperparameters
|
35 |
|
36 |
The following hyperparameters were used during training:
|
37 |
+
- learning_rate: 5e-05
|
38 |
- train_batch_size: 4
|
39 |
- eval_batch_size: 4
|
40 |
- seed: 42
|
|
|
42 |
- total_train_batch_size: 64
|
43 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
44 |
- lr_scheduler_type: linear
|
45 |
+
- lr_scheduler_warmup_steps: 8
|
46 |
+
- num_epochs: 15
|
47 |
|
48 |
### Training results
|
49 |
|
50 |
| Training Loss | Epoch | Step | Validation Loss |
|
51 |
|:-------------:|:-----:|:----:|:---------------:|
|
52 |
| 9.4233 | 0.17 | 1 | 9.1990 |
|
53 |
+
| 9.5213 | 0.34 | 2 | 8.5394 |
|
54 |
+
| 8.7467 | 0.52 | 3 | 8.1115 |
|
55 |
+
| 8.4697 | 0.69 | 4 | 7.5747 |
|
56 |
+
| 7.752 | 0.86 | 5 | 6.8712 |
|
57 |
+
| 7.0515 | 1.03 | 6 | 5.8670 |
|
58 |
+
| 6.0874 | 1.2 | 7 | 4.6814 |
|
59 |
+
| 5.0408 | 1.38 | 8 | 3.8055 |
|
60 |
+
| 4.14 | 1.55 | 9 | 2.6678 |
|
61 |
+
| 2.9893 | 1.72 | 10 | 1.9701 |
|
62 |
+
| 2.4337 | 1.89 | 11 | 1.5191 |
|
63 |
+
| 1.9451 | 2.06 | 12 | 1.2105 |
|
64 |
+
| 1.53 | 2.24 | 13 | 0.9714 |
|
65 |
+
| 1.2369 | 2.41 | 14 | 0.7905 |
|
66 |
+
| 1.0014 | 2.58 | 15 | 0.6478 |
|
67 |
+
| 0.8419 | 2.75 | 16 | 0.5493 |
|
68 |
+
| 0.7338 | 2.92 | 17 | 0.4770 |
|
69 |
+
| 0.6393 | 3.1 | 18 | 0.4151 |
|
70 |
+
| 0.5747 | 3.27 | 19 | 0.3691 |
|
71 |
+
| 0.4962 | 3.44 | 20 | 0.3293 |
|
72 |
+
| 0.4516 | 3.61 | 21 | 0.2935 |
|
73 |
+
| 0.3995 | 3.78 | 22 | 0.2614 |
|
74 |
+
| 0.3618 | 3.96 | 23 | 0.2346 |
|
75 |
+
| 0.3246 | 4.13 | 24 | 0.2129 |
|
76 |
+
| 0.2929 | 4.3 | 25 | 0.1938 |
|
77 |
+
| 0.278 | 4.47 | 26 | 0.1770 |
|
78 |
+
| 0.2493 | 4.65 | 27 | 0.1627 |
|
79 |
+
| 0.2273 | 4.82 | 28 | 0.1500 |
|
80 |
+
| 0.2067 | 4.99 | 29 | 0.1381 |
|
81 |
+
| 0.1917 | 5.16 | 30 | 0.1274 |
|
82 |
+
| 0.1805 | 5.33 | 31 | 0.1174 |
|
83 |
+
| 0.1557 | 5.51 | 32 | 0.1081 |
|
84 |
+
| 0.1495 | 5.68 | 33 | 0.1002 |
|
85 |
+
| 0.1394 | 5.85 | 34 | 0.0933 |
|
86 |
+
| 0.1261 | 6.02 | 35 | 0.0868 |
|
87 |
+
| 0.1155 | 6.19 | 36 | 0.0809 |
|
88 |
+
| 0.1114 | 6.37 | 37 | 0.0755 |
|
89 |
+
| 0.1041 | 6.54 | 38 | 0.0705 |
|
90 |
+
| 0.0952 | 6.71 | 39 | 0.0657 |
|
91 |
+
| 0.0881 | 6.88 | 40 | 0.0615 |
|
92 |
+
| 0.0823 | 7.05 | 41 | 0.0577 |
|
93 |
+
| 0.0778 | 7.23 | 42 | 0.0545 |
|
94 |
+
| 0.071 | 7.4 | 43 | 0.0515 |
|
95 |
+
| 0.07 | 7.57 | 44 | 0.0487 |
|
96 |
+
| 0.0625 | 7.74 | 45 | 0.0463 |
|
97 |
+
| 0.0589 | 7.91 | 46 | 0.0440 |
|
98 |
+
| 0.0567 | 8.09 | 47 | 0.0422 |
|
99 |
+
| 0.0537 | 8.26 | 48 | 0.0411 |
|
100 |
+
| 0.05 | 8.43 | 49 | 0.0398 |
|
101 |
+
| 0.0472 | 8.6 | 50 | 0.0384 |
|
102 |
+
| 0.0458 | 8.77 | 51 | 0.0363 |
|
103 |
+
| 0.0455 | 8.95 | 52 | 0.0347 |
|
104 |
+
| 0.0412 | 9.12 | 53 | 0.0340 |
|
105 |
+
| 0.0414 | 9.29 | 54 | 0.0326 |
|
106 |
+
| 0.0403 | 9.46 | 55 | 0.0333 |
|
107 |
+
| 0.0384 | 9.63 | 56 | 0.0303 |
|
108 |
+
| 0.0353 | 9.81 | 57 | 0.0298 |
|
109 |
+
| 0.0348 | 9.98 | 58 | 0.0293 |
|
110 |
+
| 0.0342 | 10.15 | 59 | 0.0275 |
|
111 |
+
| 0.0311 | 10.32 | 60 | 0.0272 |
|
112 |
+
| 0.0317 | 10.49 | 61 | 0.0270 |
|
113 |
+
| 0.0315 | 10.67 | 62 | 0.0261 |
|
114 |
+
| 0.0289 | 10.84 | 63 | 0.0253 |
|
115 |
+
| 0.0285 | 11.01 | 64 | 0.0247 |
|
116 |
+
| 0.0273 | 11.18 | 65 | 0.0244 |
|
117 |
+
| 0.0277 | 11.35 | 66 | 0.0240 |
|
118 |
+
| 0.0267 | 11.53 | 67 | 0.0237 |
|
119 |
+
| 0.0263 | 11.7 | 68 | 0.0237 |
|
120 |
+
| 0.0258 | 11.87 | 69 | 0.0237 |
|
121 |
+
| 0.0254 | 12.04 | 70 | 0.0238 |
|
122 |
+
| 0.0248 | 12.22 | 71 | 0.0239 |
|
123 |
+
| 0.0246 | 12.39 | 72 | 0.0239 |
|
124 |
+
| 0.0249 | 12.56 | 73 | 0.0237 |
|
125 |
+
| 0.0239 | 12.73 | 74 | 0.0236 |
|
126 |
+
| 0.0247 | 12.9 | 75 | 0.0236 |
|
127 |
|
128 |
|
129 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1625422896
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0ef05604322b62fc8762907d2aa1e85b6d0b8ab0f126133e4568ff5d32906ca1
|
3 |
size 1625422896
|
runs/Feb24_13-43-15_a191c644522c/events.out.tfevents.1708782200.a191c644522c.2522.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:43c55158d68377692b5415983ea3dfb9f821b7611984ab179e93fea462a77a3f
|
3 |
+
size 8406
|
runs/Feb24_13-45-18_a191c644522c/events.out.tfevents.1708782322.a191c644522c.2522.2
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:39b02ca101a44772a7e5a75a1a0efe79ae673079d6a4b674b246fbfb36a5dcfe
|
3 |
+
size 4184
|
runs/Feb24_13-47-25_a191c644522c/events.out.tfevents.1708782446.a191c644522c.23281.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7f9ae733a1970ef31ea540101d2119cccebf54c7daf42842bc2f5fe1d268307f
|
3 |
+
size 41363
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4856
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7b16ab82fc9d8d81d7ad806c5fa3a498c8b321492407412f20342c99275c1d65
|
3 |
size 4856
|