Hugging Face's logo

ashkid
/
shakespeare-ft

PEFT
TensorBoard
Safetensors
mistral
Generated from Trainer
4-bit precision
gptq
Model card Files Metrics Community
ashkid commited on
Commit
c331f06
•
1 Parent(s): e01a9dd

ashkid/shakespeare-ft

Browse files
Files changed (13) hide show
  1. README.md +18 -4
  2. runs/Apr23_12-25-25_9e1c58760ae9/events.out.tfevents.1713875125.9e1c58760ae9.336.0 +3 -0
  3. runs/Apr23_12-26-00_9e1c58760ae9/events.out.tfevents.1713875165.9e1c58760ae9.336.1 +3 -0
  4. runs/Apr23_12-28-47_9e1c58760ae9/events.out.tfevents.1713875329.9e1c58760ae9.336.2 +3 -0
  5. runs/Apr23_12-29-17_9e1c58760ae9/events.out.tfevents.1713875358.9e1c58760ae9.336.3 +3 -0
  6. runs/Apr23_12-33-44_9e1c58760ae9/events.out.tfevents.1713875625.9e1c58760ae9.336.4 +3 -0
  7. runs/Apr23_12-34-14_9e1c58760ae9/events.out.tfevents.1713875655.9e1c58760ae9.336.5 +3 -0
  8. runs/Apr23_12-35-47_9e1c58760ae9/events.out.tfevents.1713875748.9e1c58760ae9.336.6 +3 -0
  9. runs/Apr23_12-36-03_9e1c58760ae9/events.out.tfevents.1713875765.9e1c58760ae9.336.7 +3 -0
  10. runs/Apr23_12-52-43_0293b0e9d647/events.out.tfevents.1713876764.0293b0e9d647.553.0 +3 -0
  11. runs/Apr23_12-55-41_0293b0e9d647/events.out.tfevents.1713876944.0293b0e9d647.553.1 +3 -0
  12. runs/Apr23_13-01-24_0293b0e9d647/events.out.tfevents.1713877284.0293b0e9d647.553.2 +3 -0
  13. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.4952
20
 
21
  ## Model description
22
 
@@ -44,15 +44,29 @@ The following hyperparameters were used during training:
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
47
- - num_epochs: 2
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:----:|:---------------:|
54
- | 2.0994 | 0.97 | 15 | 1.6172 |
55
- | 1.4454 | 1.94 | 30 | 1.4952 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.7122
20
 
21
  ## Model description
22
 
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
47
+ - num_epochs: 16
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:----:|:---------------:|
54
+ | 1.3058 | 0.97 | 15 | 1.2255 |
55
+ | 1.017 | 2.0 | 31 | 1.1220 |
56
+ | 0.9377 | 2.97 | 46 | 1.0527 |
57
+ | 0.7699 | 4.0 | 62 | 0.9921 |
58
+ | 0.728 | 4.97 | 77 | 0.9438 |
59
+ | 0.6098 | 6.0 | 93 | 0.8995 |
60
+ | 0.5781 | 6.97 | 108 | 0.8649 |
61
+ | 0.4823 | 8.0 | 124 | 0.8288 |
62
+ | 0.4598 | 8.97 | 139 | 0.8065 |
63
+ | 0.3866 | 10.0 | 155 | 0.7736 |
64
+ | 0.3693 | 10.97 | 170 | 0.7525 |
65
+ | 0.3165 | 12.0 | 186 | 0.7422 |
66
+ | 0.312 | 12.97 | 201 | 0.7276 |
67
+ | 0.2761 | 14.0 | 217 | 0.7160 |
68
+ | 0.2815 | 14.97 | 232 | 0.7121 |
69
+ | 0.2463 | 15.48 | 240 | 0.7122 |
70
 
71
 
72
  ### Framework versions
runs/Apr23_12-25-25_9e1c58760ae9/events.out.tfevents.1713875125.9e1c58760ae9.336.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14f91e7c3d654c3e5be0f0ba8ecc8b10b2b66ff553f047f27c5d9daab06ca65e
3
+ size 5321
runs/Apr23_12-26-00_9e1c58760ae9/events.out.tfevents.1713875165.9e1c58760ae9.336.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ea3180e83c6f457bd19154799684cf481c44d421fbeb5e9d96b4ac31e0f9e34
3
+ size 5321
runs/Apr23_12-28-47_9e1c58760ae9/events.out.tfevents.1713875329.9e1c58760ae9.336.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:056048937fc171463072ac328c4665e0cb53a6310661603491c7f59bb03ce39d
3
+ size 5321
runs/Apr23_12-29-17_9e1c58760ae9/events.out.tfevents.1713875358.9e1c58760ae9.336.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e164923b6e4d798dc8568e7649859ef3fc6505231f5210c20ed95692d79c11d
3
+ size 5321
runs/Apr23_12-33-44_9e1c58760ae9/events.out.tfevents.1713875625.9e1c58760ae9.336.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fcb40d94412f7a416d818ea4bef7bfcc2a779ab8237c49cf37a8d317b530495
3
+ size 5321
runs/Apr23_12-34-14_9e1c58760ae9/events.out.tfevents.1713875655.9e1c58760ae9.336.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:150310d5e75dd8e113bf5926b81476a02299f26cb2ca50be00dae887975bfdde
3
+ size 5321
runs/Apr23_12-35-47_9e1c58760ae9/events.out.tfevents.1713875748.9e1c58760ae9.336.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:446695437b0399bcd1951142481276d003dfcf69e7b2751a8b5768ed53f249d3
3
+ size 5320
runs/Apr23_12-36-03_9e1c58760ae9/events.out.tfevents.1713875765.9e1c58760ae9.336.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a764731baa38e5e80cc8b7e6b67f28985bb0d38605076b4f82b73a6f89ebba79
3
+ size 5321
runs/Apr23_12-52-43_0293b0e9d647/events.out.tfevents.1713876764.0293b0e9d647.553.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b45da8750b6835e0a6caf8ff5854c081014168b13327bf54e347686fa7c79a9
3
+ size 5321
runs/Apr23_12-55-41_0293b0e9d647/events.out.tfevents.1713876944.0293b0e9d647.553.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0f8e873ebd1542d867a20efd049a313a56069b947c9c47fb370bb44812f1550
3
+ size 5321
runs/Apr23_13-01-24_0293b0e9d647/events.out.tfevents.1713877284.0293b0e9d647.553.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d685a2455af552bf4578ae9c14a9699ec268072221e22b7c49c28448ac6931a
3
+ size 13315
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3c58d5d553dc4a3c3cad7a3f24fb1ac1b32475261777ffaf17a8c1b8c3c4f6f
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72c117dc64ce2d5f2429bc50b466fe2f34196920e85530efd40abd6c190631fb
3
  size 4984