Amu commited on
Commit
5040b8b
1 Parent(s): 241d20a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -12,6 +12,10 @@ tags:
12
  # outputs
13
  This model is a fine-tuned version of [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) using [SPIN](https://github.com/uclaml/SPIN) on [ultrachat_200k dataset](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k).
14
 
 
 
 
 
15
  ## Training procedure
16
 
17
  ### Training hyperparameters
 
12
  # outputs
13
  This model is a fine-tuned version of [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) using [SPIN](https://github.com/uclaml/SPIN) on [ultrachat_200k dataset](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k).
14
 
15
+ # What's new
16
+ I think SPIN not only can use on a SFT model, but also it can use on a pretrained model.
17
+ Therefore, I use SPIN on a pretrained model microsoft/phi-2. And I get a higher score better than origin pretrained model. You can check the [open llm leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
18
+
19
  ## Training procedure
20
 
21
  ### Training hyperparameters