lenatr99 commited on
Commit
598b20d
1 Parent(s): 9f79043

loha_fine_tuned_copa_croslo

Browse files
README.md CHANGED
@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [EMBEDDIA/crosloengual-bert](https://huggingface.co/EMBEDDIA/crosloengual-bert) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 1.2211
23
- - Accuracy: 0.58
24
- - F1: 0.5810
25
 
26
  ## Model description
27
 
@@ -52,20 +52,20 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
- | 0.7164 | 1.0 | 50 | 0.6935 | 0.51 | 0.5095 |
56
- | 0.6335 | 2.0 | 100 | 0.6819 | 0.49 | 0.4894 |
57
- | 0.5152 | 3.0 | 150 | 0.6831 | 0.57 | 0.5683 |
58
- | 0.353 | 4.0 | 200 | 0.7947 | 0.59 | 0.5910 |
59
- | 0.2314 | 5.0 | 250 | 0.8754 | 0.6 | 0.6 |
60
- | 0.0845 | 6.0 | 300 | 1.1719 | 0.59 | 0.5904 |
61
- | 0.0734 | 7.0 | 350 | 1.1997 | 0.57 | 0.5709 |
62
- | 0.0537 | 8.0 | 400 | 1.2211 | 0.58 | 0.5810 |
63
 
64
 
65
  ### Framework versions
66
 
67
- - PEFT 0.10.1.dev0
68
- - Transformers 4.40.1
69
- - Pytorch 2.3.0
70
- - Datasets 2.19.0
71
  - Tokenizers 0.19.1
 
19
 
20
  This model is a fine-tuned version of [EMBEDDIA/crosloengual-bert](https://huggingface.co/EMBEDDIA/crosloengual-bert) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 1.3989
23
+ - Accuracy: 0.65
24
+ - F1: 0.6507
25
 
26
  ## Model description
27
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
+ | 0.7116 | 1.0 | 50 | 0.6663 | 0.57 | 0.5704 |
56
+ | 0.657 | 2.0 | 100 | 0.6277 | 0.62 | 0.62 |
57
+ | 0.49 | 3.0 | 150 | 0.6608 | 0.67 | 0.6708 |
58
+ | 0.3144 | 4.0 | 200 | 0.7786 | 0.68 | 0.6805 |
59
+ | 0.099 | 5.0 | 250 | 1.1639 | 0.63 | 0.6303 |
60
+ | 0.0377 | 6.0 | 300 | 1.2560 | 0.65 | 0.6496 |
61
+ | 0.0216 | 7.0 | 350 | 1.3663 | 0.65 | 0.6503 |
62
+ | 0.0107 | 8.0 | 400 | 1.3989 | 0.65 | 0.6507 |
63
 
64
 
65
  ### Framework versions
66
 
67
+ - PEFT 0.11.1
68
+ - Transformers 4.41.0
69
+ - Pytorch 2.3.0+cu121
70
+ - Datasets 2.19.1
71
  - Tokenizers 0.19.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21d8707f28bbbf144372338f4c53e9408e9bd649d3e5ec204e3bca54e436a026
3
  size 4735028
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d76e893373ae9916d5f9409ea587a2d0e8b0432e2d1aa25ebbcb2d8948d20602
3
  size 4735028
runs/May23_19-38-03_7d14fc156043/events.out.tfevents.1716493084.7d14fc156043.1518.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47ae5a19090e16a7ef038359193abd539312c210621c9c0dbf7dd712acd8cccb
3
+ size 9782
runs/May23_19-38-03_7d14fc156043/events.out.tfevents.1716493107.7d14fc156043.1518.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efc6b34f2e70153135fbe0650be374e97c2b647153fc84912a98ed4e472405cb
3
+ size 457
tokenizer.json CHANGED
@@ -1,6 +1,11 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 512,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
  "padding": null,
10
  "added_tokens": [
11
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c330eb52730c0878f2a23e7958fe83a2c9e477e88d172e053627ab264e4a1a0a
3
- size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcb88cc47b5e29b0bf7c843a950de6370870590a7a3c90a82204969cc79d0942
3
+ size 5112