grimjim
/

lemonade-rebase-32k-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

grimjim commited on Apr 11

Commit

54c68ce

•

1 Parent(s): 84b07aa

Update README.md

Update to reflect change to config.json

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ license: cc-by-4.0
 ---
 # lemonade-rebase-32k-7B
-This is a rebase merge using the formula from [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3) on Mistral v0.2 7B base (instead of v0.1), for 32K context length (eliminating the 4K sliding window), with rope theta (re)set to 40K. No other changes were made.
 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

 ---
 # lemonade-rebase-32k-7B
+This is a rebase merge using the formula from [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3) on Mistral v0.2 7B base (instead of v0.1), for 32K context length (eliminating the 4K sliding window), with rope theta set to 100K. No other changes were made.
 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).