README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - unsloth/gemma-2b-bnb-4bit
  - google/gemma-2b-it

Gemma-2b-ties

Gemma-2b-ties is a merge of the following models using mergekit:

• unsloth/gemma-2b-bnb-4bit
• google/gemma-2b-it

🧩 Configuration

```yaml models:

• model: unsloth/gemma-2b-bnb-4bit parameters: density: 0.5 weight: 0.5
• model: google/gemma-2b-it parameters: density: 0.5 weight: 0.5 # weight gradient merge_method: ties base_model: unsloth/gemma-2b-it-bnb-4bit parameters: normalize: true int8_mask: true dtype: bfloat16 ```