---
base_model:
- arcee-ai/Llama-3.1-SuperNova-Lite
- VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
- FuseAI/FuseChat-Llama-3.1-8B-SFT
- unsloth/Llama-3.1-Storm-8B
- NousResearch/Hermes-3-Llama-3.1-8B
- Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
- NeverSleep/Lumimaid-v0.2-8B
library_name: transformers
tags:
- mergekit
- merge
license: apache-2.0
---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [FuseAI/FuseChat-Llama-3.1-8B-SFT](https://huggingface.co./FuseAI/FuseChat-Llama-3.1-8B-SFT) as a base.

### Models Merged

The following models were included in the merge:
* [arcee-ai/Llama-3.1-SuperNova-Lite](https://huggingface.co./arcee-ai/Llama-3.1-SuperNova-Lite)
* [VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct](https://huggingface.co./VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct)
* [unsloth/Llama-3.1-Storm-8B](https://huggingface.co./unsloth/Llama-3.1-Storm-8B)
* [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co./NousResearch/Hermes-3-Llama-3.1-8B)
* [Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2](https://huggingface.co./Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2)
* [NeverSleep/Lumimaid-v0.2-8B](https://huggingface.co./NeverSleep/Lumimaid-v0.2-8B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
  - model: VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
  - model: arcee-ai/Llama-3.1-SuperNova-Lite
  - model: unsloth/Llama-3.1-Storm-8B
  - model: NeverSleep/Lumimaid-v0.2-8B 
  - model: NousResearch/Hermes-3-Llama-3.1-8B
merge_method: model_stock
base_model: FuseAI/FuseChat-Llama-3.1-8B-SFT
normalize: false
filter_wise: true
chat_template: "auto"
int8_mask: true
dtype: bfloat16

```