--- base_model: - jeiku/Rosa_v1_3B - jeiku/PIPPA_128_StableLM - jeiku/Rosa_v1_3B - jeiku/Theory_of_Mind_RP_128_StableLM - jeiku/Rosa_v1_3B - jeiku/Bluemoon_cleaned_StableLM - jeiku/Rosa_v1_3B - jeiku/Alpaca_128_StableLM - jeiku/Rosa_v1_3B - jeiku/Toxic_DPO_StableLM - jeiku/Rosa_v1_3B - jeiku/Rosa_v1_3B - jeiku/LimaRP_StableLM - jeiku/Rosa_v1_3B - jeiku/Gnosis_256_StableLM - jeiku/Rosa_v1_3B - jeiku/Humiliation_StableLM - jeiku/Rosa_v1_3B - jeiku/Theory_of_Mind_128_StableLM - jeiku/Rosa_v1_3B - jeiku/Futa_Erotica_StableLM - jeiku/Rosa_v1_3B - jeiku/Everything_v3_128_StableLM - jeiku/Rosa_v1_3B - jeiku/No_Robots_Alpaca_StableLM library_name: transformers tags: - mergekit - merge --- # kielbasa This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) as a base. ### Models Merged The following models were included in the merge: * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/PIPPA_128_StableLM](https://huggingface.co./jeiku/PIPPA_128_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Theory_of_Mind_RP_128_StableLM](https://huggingface.co./jeiku/Theory_of_Mind_RP_128_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Bluemoon_cleaned_StableLM](https://huggingface.co./jeiku/Bluemoon_cleaned_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Alpaca_128_StableLM](https://huggingface.co./jeiku/Alpaca_128_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Toxic_DPO_StableLM](https://huggingface.co./jeiku/Toxic_DPO_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/LimaRP_StableLM](https://huggingface.co./jeiku/LimaRP_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Gnosis_256_StableLM](https://huggingface.co./jeiku/Gnosis_256_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Humiliation_StableLM](https://huggingface.co./jeiku/Humiliation_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Theory_of_Mind_128_StableLM](https://huggingface.co./jeiku/Theory_of_Mind_128_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Futa_Erotica_StableLM](https://huggingface.co./jeiku/Futa_Erotica_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/Everything_v3_128_StableLM](https://huggingface.co./jeiku/Everything_v3_128_StableLM) * [jeiku/Rosa_v1_3B](https://huggingface.co./jeiku/Rosa_v1_3B) + [jeiku/No_Robots_Alpaca_StableLM](https://huggingface.co./jeiku/No_Robots_Alpaca_StableLM) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: dare_ties base_model: jeiku/Rosa_v1_3B parameters: normalize: true models: - model: jeiku/Rosa_v1_3B+jeiku/No_Robots_Alpaca_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Toxic_DPO_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Alpaca_128_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Everything_v3_128_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Futa_Erotica_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Gnosis_256_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Humiliation_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Theory_of_Mind_128_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/PIPPA_128_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/LimaRP_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Theory_of_Mind_RP_128_StableLM parameters: weight: 1 - model: jeiku/Rosa_v1_3B+jeiku/Bluemoon_cleaned_StableLM parameters: weight: 1 dtype: float16 ```