SGaleshchuk
/

Llama-2-13b-hf_uk_rank-32_ft

Text Generation

text-generation-inference

Model card Files Files and versions Community

SGaleshchuk commited on May 25, 2024

Commit

8af07d6

·

verified ·

1 Parent(s): 335e816

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ pipeline_tag: text-generation
 The following training arguments used for Llama-2 finetuning with Ukrainian corpora pf XL-SUM:
 - learning-rate=2e-4,
 - maximum number of tokens=512,
-- 5 epochs.
   Lora perf arguments:
 - rank = 32,
 - lora-alpha=16,

 The following training arguments used for Llama-2 finetuning with Ukrainian corpora pf XL-SUM:
 - learning-rate=2e-4,
 - maximum number of tokens=512,
+- 15 epochs.
   Lora perf arguments:
 - rank = 32,
 - lora-alpha=16,