--- base_model: - crestf411/sunfall-midnight-miqu-v0.2-v1.5-70B - TheDrummer/Moist-Miqu-70B-v1.1 library_name: transformers tags: - mergekit - merge --- # Nimbus-Miqu-70B This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [TheDrummer/Moist-Miqu-70B-v1.1](https://huggingface.co./TheDrummer/Moist-Miqu-70B-v1.1) as a base. ### Models Merged The following models were included in the merge: * [crestf411/sunfall-midnight-miqu-v0.2-v1.5-70B](https://huggingface.co./crestf411/sunfall-midnight-miqu-v0.2-v1.5-70B) * ./fp16/Moist-Euryale-Miqu-70B * ./fp16/Moist-Chronos-Miqu-70B ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: TheDrummer/Moist-Miqu-70B-v1.1 - model: ./fp16/Moist-Chronos-Miqu-70B - model: ./fp16/Moist-Euryale-Miqu-70B - model: crestf411/sunfall-midnight-miqu-v0.2-v1.5-70B base_model: TheDrummer/Moist-Miqu-70B-v1.1 merge_method: model_stock dtype: float16 ```