metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - fblgit/UNA-TheBeagle-7b-v1
  - udkai/Turdus

('Marcoroni-7b-DPO-Merge',)

('Marcoroni-7b-DPO-Merge',) is a merge of the following models using mergekit:

fblgit/UNA-TheBeagle-7b-v1
udkai/Turdus

🧩 Configuration

models:
  - model: madatnlp/marcoroni-7b-v3-safetensor
    # no parameters necessary for base model
  - model: fblgit/UNA-TheBeagle-7b-v1
    parameters:
      density: 0.3
      weight: 0.5
  - model: udkai/Turdus
    parameters:
      density: 0.7
      weight: 0.3
merge_method: ties
base_model: madatnlp/marcoroni-7b-v3-safetensor
parameters:
  normalize: true
dtype: float16