Hugging Face's logo

imdatta0
/
Qwen2-7B_magiccoder_default

PEFT
Safetensors
unsloth
Generated from Trainer
Model card Files Community
imdatta0 commited on
Commit
b177977
•
1 Parent(s): 9831500

End of training

Browse files
Files changed (2) hide show
  1. README.md +41 -41
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: unsloth/qwen2-7b-bnb-4bit
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # Qwen2-7B_magiccoder_default
17
 
18
- This model is a fine-tuned version of [unsloth/qwen2-7b-bnb-4bit](https://huggingface.co/unsloth/qwen2-7b-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.8796
21
 
22
  ## Model description
23
 
@@ -51,44 +51,44 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 0.9592 | 0.0261 | 4 | 1.0014 |
55
- | 0.9246 | 0.0522 | 8 | 0.9342 |
56
- | 0.9101 | 0.0783 | 12 | 0.9148 |
57
- | 0.8605 | 0.1044 | 16 | 0.9008 |
58
- | 0.9093 | 0.1305 | 20 | 0.8958 |
59
- | 0.7967 | 0.1566 | 24 | 0.8949 |
60
- | 0.8075 | 0.1827 | 28 | 0.8941 |
61
- | 0.9522 | 0.2088 | 32 | 0.8917 |
62
- | 0.8503 | 0.2349 | 36 | 0.8890 |
63
- | 0.8704 | 0.2610 | 40 | 0.8864 |
64
- | 0.9286 | 0.2871 | 44 | 0.8852 |
65
- | 0.894 | 0.3132 | 48 | 0.8839 |
66
- | 0.8171 | 0.3393 | 52 | 0.8835 |
67
- | 0.8224 | 0.3654 | 56 | 0.8828 |
68
- | 0.8392 | 0.3915 | 60 | 0.8822 |
69
- | 0.897 | 0.4176 | 64 | 0.8817 |
70
- | 0.8942 | 0.4437 | 68 | 0.8813 |
71
- | 0.8501 | 0.4698 | 72 | 0.8809 |
72
- | 0.8768 | 0.4959 | 76 | 0.8807 |
73
- | 0.8337 | 0.5220 | 80 | 0.8806 |
74
- | 0.9285 | 0.5481 | 84 | 0.8801 |
75
- | 0.8301 | 0.5742 | 88 | 0.8803 |
76
- | 0.9212 | 0.6003 | 92 | 0.8805 |
77
- | 0.8485 | 0.6264 | 96 | 0.8804 |
78
- | 0.9419 | 0.6525 | 100 | 0.8801 |
79
- | 0.8191 | 0.6786 | 104 | 0.8799 |
80
- | 0.8668 | 0.7047 | 108 | 0.8799 |
81
- | 0.8335 | 0.7308 | 112 | 0.8798 |
82
- | 0.8003 | 0.7569 | 116 | 0.8797 |
83
- | 0.794 | 0.7830 | 120 | 0.8796 |
84
- | 0.863 | 0.8091 | 124 | 0.8797 |
85
- | 0.8262 | 0.8352 | 128 | 0.8795 |
86
- | 0.9269 | 0.8613 | 132 | 0.8796 |
87
- | 0.876 | 0.8874 | 136 | 0.8795 |
88
- | 0.8955 | 0.9135 | 140 | 0.8794 |
89
- | 0.8481 | 0.9396 | 144 | 0.8796 |
90
- | 0.9111 | 0.9657 | 148 | 0.8795 |
91
- | 0.8653 | 0.9918 | 152 | 0.8796 |
92
 
93
 
94
  ### Framework versions
 
1
  ---
2
+ base_model: unsloth/Qwen2-7B
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
 
15
 
16
  # Qwen2-7B_magiccoder_default
17
 
18
+ This model is a fine-tuned version of [unsloth/Qwen2-7B](https://huggingface.co/unsloth/Qwen2-7B) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.9894
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 0.8215 | 0.0261 | 4 | 0.9220 |
55
+ | 0.9247 | 0.0522 | 8 | 0.9780 |
56
+ | 0.9611 | 0.0783 | 12 | 0.9693 |
57
+ | 0.9392 | 0.1044 | 16 | 0.9867 |
58
+ | 1.0135 | 0.1305 | 20 | 1.0108 |
59
+ | 0.9152 | 0.1566 | 24 | 1.0167 |
60
+ | 0.9298 | 0.1827 | 28 | 1.0251 |
61
+ | 1.0625 | 0.2088 | 32 | 1.0349 |
62
+ | 0.9695 | 0.2349 | 36 | 1.0332 |
63
+ | 1.0104 | 0.2610 | 40 | 1.0390 |
64
+ | 1.0721 | 0.2871 | 44 | 1.0406 |
65
+ | 1.0397 | 0.3132 | 48 | 1.0449 |
66
+ | 0.9623 | 0.3393 | 52 | 1.0448 |
67
+ | 0.9735 | 0.3654 | 56 | 1.0436 |
68
+ | 1.0016 | 0.3915 | 60 | 1.0431 |
69
+ | 1.0557 | 0.4176 | 64 | 1.0401 |
70
+ | 1.0377 | 0.4437 | 68 | 1.0373 |
71
+ | 1.0022 | 0.4698 | 72 | 1.0361 |
72
+ | 1.0193 | 0.4959 | 76 | 1.0328 |
73
+ | 0.9806 | 0.5220 | 80 | 1.0301 |
74
+ | 1.0542 | 0.5481 | 84 | 1.0263 |
75
+ | 0.9692 | 0.5742 | 88 | 1.0244 |
76
+ | 1.0464 | 0.6003 | 92 | 1.0215 |
77
+ | 0.9771 | 0.6264 | 96 | 1.0166 |
78
+ | 1.0659 | 0.6525 | 100 | 1.0146 |
79
+ | 0.9476 | 0.6786 | 104 | 1.0106 |
80
+ | 0.983 | 0.7047 | 108 | 1.0074 |
81
+ | 0.9585 | 0.7308 | 112 | 1.0035 |
82
+ | 0.9193 | 0.7569 | 116 | 0.9997 |
83
+ | 0.9041 | 0.7830 | 120 | 0.9975 |
84
+ | 0.9697 | 0.8091 | 124 | 0.9954 |
85
+ | 0.9464 | 0.8352 | 128 | 0.9933 |
86
+ | 1.0252 | 0.8613 | 132 | 0.9917 |
87
+ | 0.9665 | 0.8874 | 136 | 0.9909 |
88
+ | 0.9948 | 0.9135 | 140 | 0.9904 |
89
+ | 0.946 | 0.9396 | 144 | 0.9897 |
90
+ | 1.0095 | 0.9657 | 148 | 0.9896 |
91
+ | 0.9675 | 0.9918 | 152 | 0.9894 |
92
 
93
 
94
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3ed05bbfb7d803fe7e860a6438c0230f70411bc96f29e59cf94bfb5e18b84c4
3
  size 80792096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:138580dc6fdccc168af71fc4876e96085c5eab333f94e5563d9ac04face15486
3
  size 80792096