--- base_model: - Test157t/West-Pasta-Lake-7b - Test157t/Lelantacles6-Experiment26-7B library_name: transformers tags: - mergekit - merge --- # mergedmodel This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [Test157t/Lelantacles6-Experiment26-7B](https://huggingface.co./Test157t/Lelantacles6-Experiment26-7B) as a base. ### Models Merged The following models were included in the merge: * [Test157t/West-Pasta-Lake-7b](https://huggingface.co./Test157t/West-Pasta-Lake-7b) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: dare_ties base_model: Test157t/Lelantacles6-Experiment26-7B parameters: normalize: true models: - model: Test157t/West-Pasta-Lake-7b parameters: weight: 1 - model: Test157t/Lelantacles6-Experiment26-7B parameters: weight: 1 dtype: float16 ```