|
--- |
|
tags: |
|
- llama |
|
- alpaca |
|
- cot |
|
- vicuna |
|
- uncensored |
|
- merge |
|
- mix |
|
--- |
|
|
|
## 13B-BlueMethod |
|
|
|
## Composition: |
|
BlueMethod is a bit of a convoluted experiment in tiered merging. |
|
Furthering the experimental nature of the merge, the models combined |
|
were done so with a custom script that randomized the percent of each |
|
layer merged from one model to the next. This is a warmup for a larger |
|
project. |
|
[Tier One and Two Merges not released; internal naming convention] |
|
|
|
Tier One Merges: |
|
|
|
13B-Metharme+13B-Nous-Hermes=13B-Methermes |
|
|
|
13B-Vicuna-cocktail+13B-Manticore=13B-Vicortia |
|
|
|
13B-HyperMantis+13B-Alpacino=13B-PsychoMantis |
|
|
|
Tier Two Merges: |
|
|
|
13B-Methermes+13B-Vicortia=13B-Methphistopheles |
|
|
|
13B-PsychoMantis+13B-BlueMoonRP=13B-BlueMantis |
|
|
|
Tier Three Merge: |
|
|
|
13B-Methphistopheles+13B-BlueMantis=13B-BlueMethod |
|
|
|
## Use: |
|
Multiple instruct models and model composites were combined to make the final resulting model; |
|
This model is highly open to experimental prompting, both Alpaca and Vicuna instruct can be used. |
|
It can have interesting results. |
|
|
|
## Language Models and LoRAs Used Credits: |
|
|
|
13B-Metharme by PygmalionAI |
|
|
|
https://www.huggingface.co/PygmalionAI/metharme-13b |
|
|
|
13B-Nous-Hermes by NousResearch |
|
|
|
https://www.huggingface.co/NousResearch/Nous-Hermes-13b |
|
|
|
13B-Vicuna-cocktail by reeducator |
|
|
|
https://www.huggingface.co/reeducator/vicuna-13b-cocktail |
|
|
|
13B-Manticore by openaccess-ai-collective |
|
|
|
https://www.huggingface.co/openaccess-ai-collective/manticore-13b |
|
|
|
13B-HyperMantis and 13B-Alpacino by Digitous |
|
|
|
https://huggingface.co./digitous/13B-HyperMantis |
|
https://huggingface.co./digitous/Alpacino13b |
|
|
|
Also thanks to Meta for LLaMA. |
|
|
|
Each model and LoRA was hand picked and considered for what it could contribute to this ensemble. |
|
Thanks to each and every one of you for your incredible work developing some of the best things |
|
to come out of this community. |
