End of training
Browse files- README.md +12 -12
- adapter_model.safetensors +1 -1
- metrics.jsonl +2 -0
- metrics_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_2.0.json +1 -0
- metrics_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_2.0.json +1 -0
- results_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_2.0.json +0 -0
- results_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_2.0.json +0 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
-
- Loss: 0.
|
22 |
-
- Eval/rewards/chosen:
|
23 |
-
- Eval/logps/chosen: -
|
24 |
-
- Eval/rewards/rejected:
|
25 |
-
- Eval/logps/rejected: -
|
26 |
-
- Eval/rewards/margins: 0.
|
27 |
-
- Eval/kl:
|
28 |
|
29 |
## Model description
|
30 |
|
@@ -43,7 +43,7 @@ More information needed
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
-
- learning_rate:
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 1234
|
@@ -56,10 +56,10 @@ The following hyperparameters were used during training:
|
|
56 |
|
57 |
### Training results
|
58 |
|
59 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
60 |
-
|
61 |
-
| 0.
|
62 |
-
| 0.
|
63 |
|
64 |
|
65 |
### Framework versions
|
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
+
- Loss: 0.6495
|
22 |
+
- Eval/rewards/chosen: -0.0147
|
23 |
+
- Eval/logps/chosen: -197.5959
|
24 |
+
- Eval/rewards/rejected: -0.0005
|
25 |
+
- Eval/logps/rejected: -254.4111
|
26 |
+
- Eval/rewards/margins: -0.0142
|
27 |
+
- Eval/kl: 0.0906
|
28 |
|
29 |
## Model description
|
30 |
|
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
+
- learning_rate: 1e-05
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 1234
|
|
|
56 |
|
57 |
### Training results
|
58 |
|
59 |
+
| Training Loss | Epoch | Step | Validation Loss | |
|
60 |
+
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
61 |
+
| 0.8104 | 0.96 | 12 | 0.6455 | 0.1366 |
|
62 |
+
| 0.6833 | 2.0 | 25 | 0.6495 | 0.0906 |
|
63 |
|
64 |
|
65 |
### Framework versions
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 27297544
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8b45cc67d6d667c4d8a1ab0f3032f7cedab6dc4f309fe56b539f7300495bed3f
|
3 |
size 27297544
|
metrics.jsonl
CHANGED
@@ -2,3 +2,5 @@
|
|
2 |
{"epoch": 2.0, "precision": 0.0, "recall": 0.0, "fold": 0}
|
3 |
{"epoch": 0.96, "precision": 0.6363636349173554, "recall": 0.9333333302222222, "fold": 0}
|
4 |
{"epoch": 2.0, "precision": 0.8529411739619377, "recall": 0.9666666634444444, "fold": 0}
|
|
|
|
|
|
2 |
{"epoch": 2.0, "precision": 0.0, "recall": 0.0, "fold": 0}
|
3 |
{"epoch": 0.96, "precision": 0.6363636349173554, "recall": 0.9333333302222222, "fold": 0}
|
4 |
{"epoch": 2.0, "precision": 0.8529411739619377, "recall": 0.9666666634444444, "fold": 0}
|
5 |
+
{"epoch": 0.96, "precision": 0.43548387026534857, "recall": 0.899999997, "fold": 0}
|
6 |
+
{"epoch": 2.0, "precision": 0.4754098352862134, "recall": 0.9666666634444444, "fold": 0}
|
metrics_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_2.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 0.96, "precision": 0.43548387026534857, "recall": 0.899999997, "fold": 0}
|
metrics_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_2.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 2.0, "precision": 0.4754098352862134, "recall": 0.9666666634444444, "fold": 0}
|
results_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_2.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_2.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5688
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:97cd3fa005c4ebb2d26706ac9858584ceae99f4a07a031c4da87805249f0f73a
|
3 |
size 5688
|