---
base_model:
- MrRobotoAI/205
- MrRobotoAI/201
- MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K
- MrRobotoAI/202
- MrRobotoAI/206
- MrRobotoAI/204
- MrRobotoAI/200
- MrRobotoAI/203
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K](https://huggingface.co./MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K) as a base.

### Models Merged

The following models were included in the merge:
* [MrRobotoAI/205](https://huggingface.co./MrRobotoAI/205)
* [MrRobotoAI/201](https://huggingface.co./MrRobotoAI/201)
* [MrRobotoAI/202](https://huggingface.co./MrRobotoAI/202)
* [MrRobotoAI/206](https://huggingface.co./MrRobotoAI/206)
* [MrRobotoAI/204](https://huggingface.co./MrRobotoAI/204)
* [MrRobotoAI/200](https://huggingface.co./MrRobotoAI/200)
* [MrRobotoAI/203](https://huggingface.co./MrRobotoAI/203)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: MrRobotoAI/200
  - model: MrRobotoAI/201
  - model: MrRobotoAI/202
  - model: MrRobotoAI/203
  - model: MrRobotoAI/204
  - model: MrRobotoAI/205
  - model: MrRobotoAI/206
merge_method: model_stock
base_model: MrRobotoAI/Hel-v4-8b-DARK-FICTION-128K
normalize: true
dtype: float16
```