mohammedbriman commited on
Commit
6f4776b
·
verified ·
1 Parent(s): 054efb2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -17
README.md CHANGED
@@ -19,22 +19,12 @@ should probably proofread and complete it, then remove this comment. -->
19
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/m-khalid/llama-3/runs/wohqdmk3)
20
  # llama-3-8b-finetuned-turkish-instructions
21
 
22
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on the generator dataset.
23
-
24
- ## Model description
25
-
26
- More information needed
27
-
28
- ## Intended uses & limitations
29
-
30
- More information needed
31
-
32
- ## Training and evaluation data
33
-
34
- More information needed
35
 
36
  ## Training procedure
37
 
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
@@ -49,10 +39,6 @@ The following hyperparameters were used during training:
49
  - lr_scheduler_warmup_ratio: 0.03
50
  - num_epochs: 5
51
 
52
- ### Training results
53
-
54
-
55
-
56
  ### Framework versions
57
 
58
  - PEFT 0.10.1.dev0
 
19
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/m-khalid/llama-3/runs/wohqdmk3)
20
  # llama-3-8b-finetuned-turkish-instructions
21
 
22
+ This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on Turkish instructions in the [aya_dataset](https://huggingface.co/datasets/CohereForAI/aya_dataset).
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
  ## Training procedure
25
 
26
+ This model is fine-tuned using QloRA and SFT.
27
+
28
  ### Training hyperparameters
29
 
30
  The following hyperparameters were used during training:
 
39
  - lr_scheduler_warmup_ratio: 0.03
40
  - num_epochs: 5
41
 
 
 
 
 
42
  ### Framework versions
43
 
44
  - PEFT 0.10.1.dev0