gnokit commited on
Commit
74f9805
1 Parent(s): f6ab5c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -11,6 +11,22 @@ tags:
11
  base_model: unsloth/gemma-1.1-2b-it-bnb-4bit
12
  ---
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  # Uploaded model
15
 
16
  - **Developed by:** gnokit
 
11
  base_model: unsloth/gemma-1.1-2b-it-bnb-4bit
12
  ---
13
 
14
+ # Model Details:
15
+
16
+ - This model was created by finetuning the [unsloth/gemma-1.1-2b-it-bnb-4bit](https://huggingface.co/unsloth/gemma-1.1-2b-it-bnb-4bit) model using the [coedit dataset](https://huggingface.co/datasets/grammarly/coedit) from Grammarly.
17
+ - The finetuning was done following the fine-tuning notebook provided by Unsloth as a practice of finetuning using the coedit dataset.
18
+ - The model was finetuned using the prompt format of the gemma-2b-it model.
19
+ ```
20
+ <start_of_turn>user
21
+ Fix grammar in this sentence: A notable number of Chinese factories make piratical products by copying foreign products.<end_of_turn>
22
+ <start_of_turn>model
23
+ A notable number of Chinese factories make pirated products by copying foreign products.<end_of_turn>
24
+ ```
25
+ - The finetuning was done 2x faster by utilizing the Unsloth and Hugging Face's TRL library.
26
+
27
+ # Limitations:
28
+ The model was finetuned on a specific dataset (coedit) and may not generalize well to all Italian text generation tasks. Its performance may be limited compared to models trained on larger and more diverse datasets.
29
+
30
  # Uploaded model
31
 
32
  - **Developed by:** gnokit