anhvu2501 commited on
Commit
26058ec
1 Parent(s): 99e3da5

End of training

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -6,6 +6,8 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  base_model: mistralai/Mistral-7B-Instruct-v0.2
 
 
9
  model-index:
10
  - name: news-summarization-finetuned-mistral-7b
11
  results: []
@@ -16,7 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # news-summarization-finetuned-mistral-7b
18
 
19
- This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
 
 
20
 
21
  ## Model description
22
 
@@ -44,6 +48,17 @@ The following hyperparameters were used during training:
44
  - lr_scheduler_warmup_steps: 0.03
45
  - training_steps: 100
46
 
 
 
 
 
 
 
 
 
 
 
 
47
  ### Framework versions
48
 
49
  - PEFT 0.10.0
 
6
  - sft
7
  - generated_from_trainer
8
  base_model: mistralai/Mistral-7B-Instruct-v0.2
9
+ datasets:
10
+ - generator
11
  model-index:
12
  - name: news-summarization-finetuned-mistral-7b
13
  results: []
 
18
 
19
  # news-summarization-finetuned-mistral-7b
20
 
21
+ This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 2.0379
24
 
25
  ## Model description
26
 
 
48
  - lr_scheduler_warmup_steps: 0.03
49
  - training_steps: 100
50
 
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss |
54
+ |:-------------:|:------:|:----:|:---------------:|
55
+ | 2.0808 | 0.0189 | 20 | 2.1202 |
56
+ | 2.1524 | 0.0378 | 40 | 2.0725 |
57
+ | 2.0165 | 0.0567 | 60 | 2.0478 |
58
+ | 2.047 | 0.0756 | 80 | 2.0444 |
59
+ | 2.0404 | 0.0945 | 100 | 2.0379 |
60
+
61
+
62
  ### Framework versions
63
 
64
  - PEFT 0.10.0