SGEcon
/

komt-mistral-7b-v1_fin_v5

Inference Endpoints

Model card Files Files and versions Community

SGEcon commited on Feb 12

Commit

05793c4

•

1 Parent(s): 40ce112

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -117,12 +117,12 @@ The copyright of the data used belongs to the original author, so please contact
 |------|---|
 |Lora Method|Lora|
 |load in 4 bit|True|
-|learning rate|3e-5|
 |lora alpa|8|
 |lora rank|32|
 |lora dropout|0.05|
 |optim|adamw_torch|
-|target_modules|o_proj, q_proj, up_proj, down_proj, gate_proj, k_proj, v_proj|

 |------|---|
 |Lora Method|Lora|
 |load in 4 bit|True|
+|learning rate|1e-6|
 |lora alpa|8|
 |lora rank|32|
 |lora dropout|0.05|
 |optim|adamw_torch|
+|target_modules|o_proj, q_proj, up_proj, down_proj, gate_proj, k_proj, v_proj, lm_head|