|
--- |
|
license: apache-2.0 |
|
tags: |
|
- merge |
|
- mergekit |
|
- vortexmergekit |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
--- |
|
|
|
# Papa-mistral |
|
|
|
Hey there! π Welcome to the Papa-mistral! This is a merge of multiple models brought together using the awesome [VortexMerge kit](https://colab.research.google.com/drive/1YjcvCLuNG1PK7Le6_4xhVU5VpzTwvGhk#scrollTo=UG5H2TK4gVyl). |
|
|
|
Let's see what we've got in this merge: |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
* [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2) π |
|
|
|
## 𧩠Configuration |
|
|
|
```yaml |
|
dtype: float16 |
|
merge_method: passthrough |
|
slices: |
|
- sources: |
|
- layer_range: [0, 8] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
- sources: |
|
- layer_range: [4, 12] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
- sources: |
|
- layer_range: [8, 16] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
- sources: |
|
- layer_range: [12, 20] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
- sources: |
|
- layer_range: [16, 24] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
- sources: |
|
- layer_range: [20, 28] |
|
model: mistralai/Mistral-7B-Instruct-v0.2 |
|
|