Hugging Face's logo

imdatta0
/
Qwen2-7B_pct_ortho

PEFT
Safetensors
unsloth
Generated from Trainer
Model card Files Community
imdatta0 commited on
Commit
3e0d38c
•
1 Parent(s): bd3ee62

End of training

Browse files
Files changed (2) hide show
  1. README.md +51 -51
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: unsloth/qwen2-7b-bnb-4bit
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # Qwen2-7B_pct_ortho
17
 
18
- This model is a fine-tuned version of [unsloth/qwen2-7b-bnb-4bit](https://huggingface.co/unsloth/qwen2-7b-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.1027
21
 
22
  ## Model description
23
 
@@ -51,54 +51,54 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 2.1596 | 0.0206 | 8 | 2.0832 |
55
- | 2.095 | 0.0412 | 16 | 2.0465 |
56
- | 2.1302 | 0.0618 | 24 | 2.0538 |
57
- | 2.0886 | 0.0824 | 32 | 2.0696 |
58
- | 2.1386 | 0.1031 | 40 | 2.0840 |
59
- | 2.141 | 0.1237 | 48 | 2.0979 |
60
- | 2.1451 | 0.1443 | 56 | 2.0972 |
61
- | 2.1323 | 0.1649 | 64 | 2.1059 |
62
- | 2.152 | 0.1855 | 72 | 2.1132 |
63
- | 2.2215 | 0.2061 | 80 | 2.1120 |
64
- | 2.187 | 0.2267 | 88 | 2.1149 |
65
- | 2.1712 | 0.2473 | 96 | 2.1171 |
66
- | 2.2009 | 0.2680 | 104 | 2.1281 |
67
- | 2.1177 | 0.2886 | 112 | 2.1351 |
68
- | 2.1735 | 0.3092 | 120 | 2.1326 |
69
- | 2.1785 | 0.3298 | 128 | 2.1293 |
70
- | 2.1826 | 0.3504 | 136 | 2.1398 |
71
- | 2.1799 | 0.3710 | 144 | 2.1419 |
72
- | 2.1817 | 0.3916 | 152 | 2.1564 |
73
- | 2.2199 | 0.4122 | 160 | 2.1452 |
74
- | 2.2533 | 0.4329 | 168 | 2.1420 |
75
- | 2.1606 | 0.4535 | 176 | 2.1434 |
76
- | 2.1773 | 0.4741 | 184 | 2.1394 |
77
- | 2.2177 | 0.4947 | 192 | 2.1369 |
78
- | 2.1614 | 0.5153 | 200 | 2.1360 |
79
- | 2.2003 | 0.5359 | 208 | 2.1389 |
80
- | 2.2389 | 0.5565 | 216 | 2.1424 |
81
- | 2.1515 | 0.5771 | 224 | 2.1329 |
82
- | 2.16 | 0.5977 | 232 | 2.1388 |
83
- | 2.1584 | 0.6184 | 240 | 2.1229 |
84
- | 2.1446 | 0.6390 | 248 | 2.1275 |
85
- | 2.19 | 0.6596 | 256 | 2.1256 |
86
- | 2.1612 | 0.6802 | 264 | 2.1182 |
87
- | 2.2218 | 0.7008 | 272 | 2.1202 |
88
- | 2.1112 | 0.7214 | 280 | 2.1163 |
89
- | 2.2125 | 0.7420 | 288 | 2.1118 |
90
- | 2.1432 | 0.7626 | 296 | 2.1115 |
91
- | 2.1537 | 0.7833 | 304 | 2.1066 |
92
- | 2.1391 | 0.8039 | 312 | 2.1069 |
93
- | 2.1831 | 0.8245 | 320 | 2.1115 |
94
- | 2.1835 | 0.8451 | 328 | 2.1099 |
95
- | 2.1461 | 0.8657 | 336 | 2.1126 |
96
- | 2.183 | 0.8863 | 344 | 2.1060 |
97
- | 2.1507 | 0.9069 | 352 | 2.1017 |
98
- | 2.216 | 0.9275 | 360 | 2.1033 |
99
- | 2.1464 | 0.9481 | 368 | 2.1032 |
100
- | 2.1925 | 0.9688 | 376 | 2.1028 |
101
- | 2.1514 | 0.9894 | 384 | 2.1027 |
102
 
103
 
104
  ### Framework versions
 
1
  ---
2
+ base_model: unsloth/Qwen2-7B
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
 
15
 
16
  # Qwen2-7B_pct_ortho
17
 
18
+ This model is a fine-tuned version of [unsloth/Qwen2-7B](https://huggingface.co/unsloth/Qwen2-7B) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 2.0729
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 2.0844 | 0.0206 | 8 | 1.9994 |
55
+ | 2.0447 | 0.0412 | 16 | 1.9901 |
56
+ | 2.0874 | 0.0618 | 24 | 2.0098 |
57
+ | 2.0412 | 0.0824 | 32 | 2.0256 |
58
+ | 2.0961 | 0.1031 | 40 | 2.0402 |
59
+ | 2.1029 | 0.1237 | 48 | 2.0545 |
60
+ | 2.1077 | 0.1443 | 56 | 2.0568 |
61
+ | 2.0953 | 0.1649 | 64 | 2.0666 |
62
+ | 2.1231 | 0.1855 | 72 | 2.0795 |
63
+ | 2.187 | 0.2061 | 80 | 2.0806 |
64
+ | 2.1587 | 0.2267 | 88 | 2.0897 |
65
+ | 2.1437 | 0.2473 | 96 | 2.0826 |
66
+ | 2.1689 | 0.2680 | 104 | 2.0951 |
67
+ | 2.0886 | 0.2886 | 112 | 2.1059 |
68
+ | 2.1436 | 0.3092 | 120 | 2.1058 |
69
+ | 2.1525 | 0.3298 | 128 | 2.1013 |
70
+ | 2.1577 | 0.3504 | 136 | 2.1073 |
71
+ | 2.1438 | 0.3710 | 144 | 2.1086 |
72
+ | 2.1596 | 0.3916 | 152 | 2.1189 |
73
+ | 2.1911 | 0.4122 | 160 | 2.1118 |
74
+ | 2.225 | 0.4329 | 168 | 2.1125 |
75
+ | 2.1364 | 0.4535 | 176 | 2.1086 |
76
+ | 2.1469 | 0.4741 | 184 | 2.1079 |
77
+ | 2.19 | 0.4947 | 192 | 2.1081 |
78
+ | 2.1236 | 0.5153 | 200 | 2.1063 |
79
+ | 2.1678 | 0.5359 | 208 | 2.1112 |
80
+ | 2.2087 | 0.5565 | 216 | 2.1102 |
81
+ | 2.1172 | 0.5771 | 224 | 2.0990 |
82
+ | 2.1274 | 0.5977 | 232 | 2.1043 |
83
+ | 2.1229 | 0.6184 | 240 | 2.0957 |
84
+ | 2.1097 | 0.6390 | 248 | 2.0978 |
85
+ | 2.1596 | 0.6596 | 256 | 2.0958 |
86
+ | 2.1294 | 0.6802 | 264 | 2.0876 |
87
+ | 2.1938 | 0.7008 | 272 | 2.0930 |
88
+ | 2.0728 | 0.7214 | 280 | 2.0849 |
89
+ | 2.1827 | 0.7420 | 288 | 2.0802 |
90
+ | 2.1082 | 0.7626 | 296 | 2.0804 |
91
+ | 2.1212 | 0.7833 | 304 | 2.0782 |
92
+ | 2.1074 | 0.8039 | 312 | 2.0761 |
93
+ | 2.1474 | 0.8245 | 320 | 2.0791 |
94
+ | 2.1557 | 0.8451 | 328 | 2.0802 |
95
+ | 2.1122 | 0.8657 | 336 | 2.0803 |
96
+ | 2.1462 | 0.8863 | 344 | 2.0764 |
97
+ | 2.119 | 0.9069 | 352 | 2.0713 |
98
+ | 2.1888 | 0.9275 | 360 | 2.0730 |
99
+ | 2.1138 | 0.9481 | 368 | 2.0733 |
100
+ | 2.1631 | 0.9688 | 376 | 2.0732 |
101
+ | 2.1142 | 0.9894 | 384 | 2.0729 |
102
 
103
 
104
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8468a344a2a6d7e866cc446382b6f0909bf8e6afaa8f454f1885c9a5b8e503f2
3
  size 80792096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:604a3c009574e373df175757f592deafd4a939659cd5c091b32bd24ecc812e93
3
  size 80792096