File size: 1,806 Bytes
122861e 7058ea1 ac26249 0b1acc1 bb3cd43 0b1acc1 d384792 a21ed5c 677c399 a48e125 b444e22 ec0c52f b444e22 60afe2f b444e22 7058ea1 d384792 7058ea1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
tags:
- mistral
- merge
---
experiment-A
# DupletBoreas-7B-t0.0001
## A merge of the following models using a custom NearSwap algorithm:
* [fearlessdots/WizardLM-2-7B-abliterated](https://huggingface.co./fearlessdots/WizardLM-2-7B-abliterated)
* [Virt-io/Erebus-Holodeck-7B](https://huggingface.co./Virt-io/Erebus-Holodeck-7B)
With [fearlessdots/WizardLM-2-7B-abliterated](https://huggingface.co./fearlessdots/WizardLM-2-7B-abliterated) as the base model.
## Thanks mradermacher for the quants!
* [GGUF](https://huggingface.co./mradermacher/DupletBoreas-7B-t0.0001-GGUF)
* [GGUF imatrix](https://huggingface.co./mradermacher/DupletBoreas-7B-t0.0001-i1-GGUF)
https://huggingface.co./v000000/DupletBoreas-7B-t0.0001-Q8_0-GGUF
https://huggingface.co./v000000/DupletBoreas-7B-t0.0001-Q5_K_S-GGUF
```python
#Fixed
def lerp(a, b, t):
return a * (1 - t) + b * t
def nearswap(v0, v1, t):
lweight = np.abs(v0 - v1)
with np.errstate(divide='ignore', invalid='ignore'):
lweight = np.where(lweight != 0, t / lweight, 1.0)
lweight = np.nan_to_num(lweight, nan=1.0, posinf=1.0, neginf=1.0)
np.clip(lweight, a_min=0.0, a_max=1.0, out=lweight)
return lerp(v0, v1, lweight)
```
Credit Alchemonaut
<b>WizardLM-2</b> adopts the prompt format from <b>Vicuna</b> and supports **multi-turn** conversation. The prompt should be as following:
```
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful,
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
USER: Who are you? ASSISTANT: I am WizardLM.</s>......
```
<b>Add Genre's in a list like this.</b>
```
[Genre: <genre1>, <genre2>]
``` |