--- base_model: - NeverSleep/Lumimaid-v0.2-8B - kloodia/lora-8b-medic - nothingiisreal/L3.1-8B-Celeste-V1.5 - kloodia/lora-8b-bio - mlabonne/Hermes-3-Llama-3.1-8B-lorablated - Azazelle/RP_Format_QuoteAsterisk_Llama3 - vicgalle/Configurable-Llama-3.1-8B-Instruct - kloodia/lora-8b-physic - Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 library_name: transformers tags: - mergekit - merge - roleplay - llama - llama-3.1 license: apache-2.0 --- # ⚛️ Gluon-8B This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Quantizations ### GGUF - [Static Quants](https://huggingface.co./mradermacher/Gluon-8B-GGUF) - [Imatrix Quants](https://huggingface.co./mradermacher/Gluon-8B-i1-GGUF) - [Only Q8_0](https://huggingface.co./dasChronos1/Gluon-8B-Q8_0-GGUF) ## Models Merged The following models were included in the merge: * [NeverSleep/Lumimaid-v0.2-8B](https://huggingface.co./NeverSleep/Lumimaid-v0.2-8B) + [kloodia/lora-8b-medic](https://huggingface.co./kloodia/lora-8b-medic) * [nothingiisreal/L3.1-8B-Celeste-V1.5](https://huggingface.co./nothingiisreal/L3.1-8B-Celeste-V1.5) + [kloodia/lora-8b-bio](https://huggingface.co./kloodia/lora-8b-bio) * [mlabonne/Hermes-3-Llama-3.1-8B-lorablated](https://huggingface.co./mlabonne/Hermes-3-Llama-3.1-8B-lorablated) + [Azazelle/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co./Azazelle/RP_Format_QuoteAsterisk_Llama3) * [vicgalle/Configurable-Llama-3.1-8B-Instruct](https://huggingface.co./vicgalle/Configurable-Llama-3.1-8B-Instruct) + [kloodia/lora-8b-physic](https://huggingface.co./kloodia/lora-8b-physic) ## Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated+Azazelle/RP_Format_QuoteAsterisk_Llama3 - model: vicgalle/Configurable-Llama-3.1-8B-Instruct+kloodia/lora-8b-physic - model: NeverSleep/Lumimaid-v0.2-8B+kloodia/lora-8b-medic - model: nothingiisreal/L3.1-8B-Celeste-V1.5+kloodia/lora-8b-bio merge_method: model_stock base_model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 normalize: true int8_mask: true dtype: float16 ```