student-abdullah
/

Llama3.1_Medicine_Hinglish_Fine-Tuned_27-09_LoRA_Layers

Model card Files Files and versions Community

student-abdullah commited on Sep 27

Commit

a2b148e

•

1 Parent(s): af3026a

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ datasets:
 - **Developed by:** student-abdullah
 - **Finetuned from model:** meta-llama/Meta-Llama-3.1-8B
 - **Created on:** 27th September, 2024
-- **Full model:** student-abdullah/llama3.1_medicine_hinglish_fine-tuned_27-09_8bits_gguf
 ---
 # Acknowledgement
@@ -24,7 +24,7 @@ This LoRA adapter layer model is fine-tuned from the meta-llama/Meta-Llama-3.1-8
 - Fine Tuning Template: Llama 3.1 Q&A
 - Max Tokens: 512
-- LoRA Alpha: 16
 - LoRA Rank (r): 128
 - Learning rate: 2e-4
 - Gradient Accumulation Steps: 2
@@ -32,7 +32,7 @@ This LoRA adapter layer model is fine-tuned from the meta-llama/Meta-Llama-3.1-8
 ---
 # Model Quantitative Performace
-- Training Quantitative Loss: 0.141 (at final 300th epoch)
 ---
 # Limitations

 - **Developed by:** student-abdullah
 - **Finetuned from model:** meta-llama/Meta-Llama-3.1-8B
 - **Created on:** 27th September, 2024
+- **Full model:** student-abdullah/llama3.1_medicine_hinglish_fine-tuned_26-09_8bits_gguf
 ---
 # Acknowledgement
 - Fine Tuning Template: Llama 3.1 Q&A
 - Max Tokens: 512
+- LoRA Alpha: 32
 - LoRA Rank (r): 128
 - Learning rate: 2e-4
 - Gradient Accumulation Steps: 2
 ---
 # Model Quantitative Performace
+- Training Quantitative Loss: 0.1368 (at final 300th epoch)
 ---
 # Limitations