Hugging Face's logo

TNE-AI
/
Echo-IE-3B-v0.1

Text Generation
Transformers
Safetensors
llama
trl
orpo
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Rakuto commited on
Commit
96c1ff4
·
verified ·
1 Parent(s): e1f7016

End of training

Browse files
Files changed (4) hide show
  1. README.md +22 -22
  2. model-00001-of-00002.safetensors +1 -1
  3. model-00002-of-00002.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -18,18 +18,18 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.1513
22
- - Rewards/chosen: -0.0341
23
- - Rewards/rejected: -0.2967
24
- - Rewards/accuracies: 0.9688
25
- - Rewards/margins: 0.2626
26
- - Logps/rejected: -2.9667
27
- - Logps/chosen: -0.3407
28
- - Logits/rejected: 0.9754
29
- - Logits/chosen: 0.9495
30
- - Nll Loss: 0.1436
31
- - Log Odds Ratio: -0.0679
32
- - Log Odds Chosen: 3.8381
33
 
34
  ## Model description
35
 
@@ -61,16 +61,16 @@ The following hyperparameters were used during training:
61
 
62
  | Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen | Nll Loss | Log Odds Ratio | Log Odds Chosen |
63
  |:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:|:--------------:|:------------:|:---------------:|:-------------:|:--------:|:--------------:|:---------------:|
64
- | 0.4124 | 1.0 | 44 | 0.3215 | -0.0650 | -0.1203 | 1.0 | 0.0553 | -1.2029 | -0.6500 | 0.4436 | 0.4952 | 0.2843 | -0.3461 | 0.9531 |
65
- | 0.2262 | 2.0 | 88 | 0.2173 | -0.0463 | -0.1815 | 1.0 | 0.1352 | -1.8149 | -0.4629 | 0.6564 | 0.6969 | 0.2000 | -0.1529 | 2.1688 |
66
- | 0.1567 | 3.0 | 132 | 0.1848 | -0.0402 | -0.2383 | 0.9688 | 0.1981 | -2.3833 | -0.4018 | 0.8186 | 0.8245 | 0.1734 | -0.0986 | 2.9871 |
67
- | 0.1483 | 4.0 | 176 | 0.1688 | -0.0372 | -0.2683 | 0.9688 | 0.2311 | -2.6830 | -0.3718 | 0.9081 | 0.8980 | 0.1594 | -0.0814 | 3.4098 |
68
- | 0.1313 | 5.0 | 220 | 0.1597 | -0.0355 | -0.2806 | 0.9688 | 0.2451 | -2.8056 | -0.3550 | 0.9172 | 0.9010 | 0.1511 | -0.0746 | 3.6020 |
69
- | 0.1173 | 6.0 | 264 | 0.1558 | -0.0348 | -0.2900 | 0.9688 | 0.2552 | -2.9003 | -0.3481 | 0.9633 | 0.9417 | 0.1476 | -0.0712 | 3.7352 |
70
- | 0.131 | 7.0 | 308 | 0.1525 | -0.0342 | -0.2935 | 0.9688 | 0.2592 | -2.9346 | -0.3424 | 0.9745 | 0.9506 | 0.1446 | -0.0690 | 3.7927 |
71
- | 0.1097 | 8.0 | 352 | 0.1516 | -0.0341 | -0.2956 | 0.9688 | 0.2614 | -2.9556 | -0.3411 | 0.9658 | 0.9406 | 0.1438 | -0.0684 | 3.8234 |
72
- | 0.0973 | 9.0 | 396 | 0.1512 | -0.0340 | -0.2965 | 0.9688 | 0.2625 | -2.9653 | -0.3403 | 0.9691 | 0.9441 | 0.1434 | -0.0682 | 3.8372 |
73
- | 0.1161 | 10.0 | 440 | 0.1513 | -0.0341 | -0.2967 | 0.9688 | 0.2626 | -2.9667 | -0.3407 | 0.9754 | 0.9495 | 0.1436 | -0.0679 | 3.8381 |
74
 
75
 
76
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.1664
22
+ - Rewards/chosen: -0.0370
23
+ - Rewards/rejected: -0.3280
24
+ - Rewards/accuracies: 1.0
25
+ - Rewards/margins: 0.2910
26
+ - Logps/rejected: -3.2803
27
+ - Logps/chosen: -0.3698
28
+ - Logits/rejected: 1.0091
29
+ - Logits/chosen: 0.9877
30
+ - Nll Loss: 0.1600
31
+ - Log Odds Ratio: -0.0425
32
+ - Log Odds Chosen: 4.2039
33
 
34
  ## Model description
35
 
 
61
 
62
  | Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen | Nll Loss | Log Odds Ratio | Log Odds Chosen |
63
  |:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:|:--------------:|:------------:|:---------------:|:-------------:|:--------:|:--------------:|:---------------:|
64
+ | 0.3327 | 1.0 | 44 | 0.3234 | -0.0664 | -0.1431 | 1.0 | 0.0767 | -1.4309 | -0.6641 | 0.4718 | 0.5480 | 0.2905 | -0.2860 | 1.2590 |
65
+ | 0.2004 | 2.0 | 88 | 0.2283 | -0.0488 | -0.2296 | 1.0 | 0.1809 | -2.2965 | -0.4877 | 0.6711 | 0.7162 | 0.2142 | -0.1075 | 2.7194 |
66
+ | 0.1661 | 3.0 | 132 | 0.1974 | -0.0423 | -0.2767 | 1.0 | 0.2344 | -2.7672 | -0.4230 | 0.8238 | 0.8408 | 0.1878 | -0.0679 | 3.4301 |
67
+ | 0.1227 | 4.0 | 176 | 0.1813 | -0.0392 | -0.2999 | 1.0 | 0.2607 | -2.9992 | -0.3919 | 0.8916 | 0.8935 | 0.1734 | -0.0541 | 3.7906 |
68
+ | 0.1434 | 5.0 | 220 | 0.1743 | -0.0380 | -0.3141 | 1.0 | 0.2762 | -3.1414 | -0.3799 | 0.9271 | 0.9167 | 0.1671 | -0.0484 | 4.0032 |
69
+ | 0.0994 | 6.0 | 264 | 0.1697 | -0.0373 | -0.3202 | 1.0 | 0.2828 | -3.2017 | -0.3732 | 0.9822 | 0.9679 | 0.1629 | -0.0453 | 4.0966 |
70
+ | 0.0896 | 7.0 | 308 | 0.1677 | -0.0371 | -0.3247 | 1.0 | 0.2876 | -3.2469 | -0.3706 | 0.9892 | 0.9698 | 0.1612 | -0.0436 | 4.1599 |
71
+ | 0.1047 | 8.0 | 352 | 0.1666 | -0.0370 | -0.3268 | 1.0 | 0.2899 | -3.2685 | -0.3695 | 1.0025 | 0.9822 | 0.1602 | -0.0429 | 4.1914 |
72
+ | 0.0979 | 9.0 | 396 | 0.1662 | -0.0369 | -0.3281 | 1.0 | 0.2911 | -3.2808 | -0.3694 | 1.0120 | 0.9910 | 0.1598 | -0.0426 | 4.2063 |
73
+ | 0.0986 | 10.0 | 440 | 0.1664 | -0.0370 | -0.3280 | 1.0 | 0.2910 | -3.2803 | -0.3698 | 1.0091 | 0.9877 | 0.1600 | -0.0425 | 4.2039 |
74
 
75
 
76
  ### Framework versions
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ebc8e835d41d51bab7d3def601ef54277ca8267d3a791c9a883a18a0e65fbebc
3
  size 4965799096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43d5884c5790d515a72098fbdde738f4c57f17fa52e9969f3c145e0a2bcced95
3
  size 4965799096
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a10819e43048c01a4631306d7c2ffea05b327cbad6903842ec47e6a98b1e2ab
3
  size 1459729952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:967dfc1bfbdee10bc5290127a9e28525c3edd83108522209b5260245f5765905
3
  size 1459729952
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d81b791e629c71c9cfb2c36bde9032762e7a3e65d18776e4c33da1f1d52c7a67
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26f4af29aeed7de9a3d2f21638401266a44206f20911dd5f0e6acdcac9491c0f
3
  size 5496