|
|
|
--- |
|
|
|
base_model: [] |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
|
|
|
|
--- |
|
|
|
[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory) |
|
|
|
|
|
# QuantFactory/NIHAPPY-L3.1-8B-v0.09-GGUF |
|
This is quantized version of [Arkana08/NIHAPPY-L3.1-8B-v0.09](https://huggingface.co./Arkana08/NIHAPPY-L3.1-8B-v0.09) created using llama.cpp |
|
|
|
# Original Model Card |
|
|
|
### (GGUF) Thanks mradermacher |
|
|
|
- **GGUF:** **[mradermacher/NIHAPPY-L3.1-8B-v0.09-GGUF](https://huggingface.co./mradermacher/NIHAPPY-L3.1-8B-v0.09-GGUF)** |
|
- **imatrix GGUF:** **[mradermacher/NIHAPPY-L3.1-8B-v0.09-i1-GGUF](https://huggingface.co./mradermacher/NIHAPPY-L3.1-8B-v0.09-i1-GGUF)** |
|
|
|
**NIHAPPY** a role-playing model that seamlessly integrates the finest qualities of various pre-trained language models. Crafted with a focus on dynamic storytelling, NIHAPPY thrives in creative and immersive roleplaying environments. It masterfully balances intricate reasoning with a smooth and consistent narrative flow, ensuring an engaging and coherent experience. |
|
|
|
## Merge Details |
|
|
|
### Merge Method |
|
This model was created using the **DARE TIES** merge method, with **[v000000/L3.1-Niitorm-8B-DPO-t0.0001](https://huggingface.co./v000000/L3.1-Niitorm-8B-DPO-t0.0001)** serving as the base model. This approach ensures a fine-tuned balance between creativity, reasoning, and rule-following, ideal for intricate role-playing situations. |
|
|
|
### Models Merged |
|
The following models were included in the merge: |
|
|
|
- **[Nitral-AI/Hathor_Tahsin-L3-8B-v0.85](https://huggingface.co./Nitral-AI/Hathor_Tahsin-L3-8B-v0.85)**: Contributes to rule-following, consistency, and character accuracy. |
|
- **[v000000/L3.1-Niitorm-8B-DPO-t0.0001](https://huggingface.co./v000000/L3.1-Niitorm-8B-DPO-t0.0001)**: A strong foundation for reasoning and logical responses. |
|
- **[v000000/L3-8B-Poppy-Moonfall-C](https://huggingface.co./v000000/L3-8B-Poppy-Moonfall-C)**: Focuses on storytelling, imagination, and creative expression. |
|
|
|
## Configuration |
|
|
|
The following YAML configuration was used to produce NIHAPPY: |
|
|
|
```yaml |
|
models: |
|
- model: v000000/L3.1-Niitorm-8B-DPO-t0.0001 |
|
parameters: |
|
weight: 0.35 |
|
density: 0.65 |
|
- model: v000000/L3-8B-Poppy-Moonfall-C |
|
parameters: |
|
weight: 0.45 |
|
density: 0.65 |
|
- model: Nitral-AI/Hathor_Tahsin-L3-8B-v0.85 |
|
parameters: |
|
weight: 0.20 |
|
density: 0.68 |
|
merge_method: dare_ties |
|
base_model: v000000/L3.1-Niitorm-8B-DPO-t0.0001 |
|
parameters: |
|
int8_mask: true |
|
dtype: bfloat16 |
|
``` |
|
|
|
## Credits |
|
Thanks to the creators of the models: |
|
|
|
- **[Nitral-AI/Hathor_Tahsin-L3-8B-v0.85](https://huggingface.co./Nitral-AI/Hathor_Tahsin-L3-8B-v0.85)** |
|
- **[v000000/L3.1-Niitorm-8B-DPO-t0.0001](https://huggingface.co./v000000/L3.1-Niitorm-8B-DPO-t0.0001)** |
|
- **[v000000/L3-8B-Poppy-Moonfall-C](https://huggingface.co./v000000/L3-8B-Poppy-Moonfall-C)** |
|
|