Pipper commited on
Commit
19b1121
1 Parent(s): 9c62478

training latge t5 comment 2 code done 12/12/2023, 18:44:34

Browse files
Files changed (4) hide show
  1. README.md +23 -23
  2. config.json +1 -1
  3. pytorch_model.bin +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: Salesforce/codet5-base
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # SolCoder
15
 
16
- This model is a fine-tuned version of [Salesforce/codet5-base](https://huggingface.co/Salesforce/codet5-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.6043
19
 
20
  ## Model description
21
 
@@ -50,26 +50,26 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:------:|:---------------:|
53
- | 1.0314 | 1.0 | 7440 | 0.9257 |
54
- | 0.919 | 2.0 | 14880 | 0.8329 |
55
- | 0.8463 | 3.0 | 22320 | 0.7831 |
56
- | 0.8025 | 4.0 | 29760 | 0.7471 |
57
- | 0.764 | 5.0 | 37200 | 0.7218 |
58
- | 0.738 | 6.0 | 44640 | 0.6986 |
59
- | 0.7101 | 7.0 | 52080 | 0.6823 |
60
- | 0.6915 | 8.0 | 59520 | 0.6681 |
61
- | 0.6738 | 9.0 | 66960 | 0.6560 |
62
- | 0.6543 | 10.0 | 74400 | 0.6480 |
63
- | 0.6438 | 11.0 | 81840 | 0.6380 |
64
- | 0.6285 | 12.0 | 89280 | 0.6312 |
65
- | 0.6163 | 13.0 | 96720 | 0.6250 |
66
- | 0.6093 | 14.0 | 104160 | 0.6187 |
67
- | 0.5967 | 15.0 | 111600 | 0.6149 |
68
- | 0.5914 | 16.0 | 119040 | 0.6114 |
69
- | 0.5827 | 17.0 | 126480 | 0.6079 |
70
- | 0.5758 | 18.0 | 133920 | 0.6059 |
71
- | 0.5724 | 19.0 | 141360 | 0.6045 |
72
- | 0.5653 | 20.0 | 148800 | 0.6043 |
73
 
74
 
75
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: Pipper/SolCoder
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
13
 
14
  # SolCoder
15
 
16
+ This model is a fine-tuned version of [Pipper/SolCoder](https://huggingface.co/Pipper/SolCoder) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.5568
19
 
20
  ## Model description
21
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:------:|:---------------:|
53
+ | 0.6094 | 1.0 | 7440 | 0.6185 |
54
+ | 0.598 | 2.0 | 14880 | 0.6124 |
55
+ | 0.5845 | 3.0 | 22320 | 0.6075 |
56
+ | 0.5723 | 4.0 | 29760 | 0.6006 |
57
+ | 0.5589 | 5.0 | 37200 | 0.5943 |
58
+ | 0.5495 | 6.0 | 44640 | 0.5894 |
59
+ | 0.5371 | 7.0 | 52080 | 0.5861 |
60
+ | 0.5291 | 8.0 | 59520 | 0.5811 |
61
+ | 0.52 | 9.0 | 66960 | 0.5765 |
62
+ | 0.5095 | 10.0 | 74400 | 0.5746 |
63
+ | 0.5056 | 11.0 | 81840 | 0.5700 |
64
+ | 0.4967 | 12.0 | 89280 | 0.5682 |
65
+ | 0.4894 | 13.0 | 96720 | 0.5659 |
66
+ | 0.4861 | 14.0 | 104160 | 0.5619 |
67
+ | 0.4773 | 15.0 | 111600 | 0.5599 |
68
+ | 0.4754 | 16.0 | 119040 | 0.5599 |
69
+ | 0.4689 | 17.0 | 126480 | 0.5578 |
70
+ | 0.4642 | 18.0 | 133920 | 0.5575 |
71
+ | 0.4627 | 19.0 | 141360 | 0.5566 |
72
+ | 0.4573 | 20.0 | 148800 | 0.5568 |
73
 
74
 
75
  ### Framework versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "Salesforce/codet5-base",
3
  "architectures": [
4
  "T5ForConditionalGeneration"
5
  ],
 
1
  {
2
+ "_name_or_path": "Pipper/SolCoder",
3
  "architectures": [
4
  "T5ForConditionalGeneration"
5
  ],
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc1c1ffe877771eb7458541517e1caae752e550fece1146fbfe61a5ec9a64cf4
3
  size 891617358
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b84af983fb40101175527272a9a9cc98b3a832e5d6e3674d21894e6e2af34707
3
  size 891617358
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2d73b509a28e59cbf3d5a6f990bd34c3850e4771a5fd6a62fc23cd76f6bc6b0
3
  size 4600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afebe0d6daa15db4c0b14e6676a2c23ac388f1a5e4fb7be45495becbb99403f8
3
  size 4600