--- base_model: - Aleteian/base-ground-2 - elinas/Chronos-Gold-12B-1.0 - IlyaGusev/saiga_nemo_12b - DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the breadcrumbs_ties merge method using [Aleteian/base-ground-2](https://huggingface.co./Aleteian/base-ground-2) as a base. ### Models Merged The following models were included in the merge: * [elinas/Chronos-Gold-12B-1.0](https://huggingface.co./elinas/Chronos-Gold-12B-1.0) * [IlyaGusev/saiga_nemo_12b](https://huggingface.co./IlyaGusev/saiga_nemo_12b) * [DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS](https://huggingface.co./DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: Aleteian/base-ground-2 parameters: density: 0.9 weight: 0.4 gamma: 0.01 - model: DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS parameters: density: 0.9 weight: 0.3 gamma: 0.01 - model: elinas/Chronos-Gold-12B-1.0 parameters: density: 0.9 weight: 0.2 gamma: 0.01 - model: IlyaGusev/saiga_nemo_12b parameters: density: 0.9 weight: 0.1 gamma: 0.01 merge_method: breadcrumbs_ties base_model: Aleteian/base-ground-2 dtype: float32 tokenizer_source: "union" chat_template: "chatml" ```