metadata
base_model:
- jondurbin/bagel-dpo-34b-v0.2
- jondurbin/nontoxic-bagel-34b-v0.2
tags:
- mergekit
- merge
license: other
license_name: yi-license
license_link: https://huggingface.co./01-ai/Yi-34B-200K/blob/main/LICENSE
yi-bagel-2x34b
Released January 11, 2024
This is a merge of pre-trained language models created using mergekit. For more information, kindly refer to the model cards from jondurbin linked in a section below.
Merge Details
Merge Method
This model is an expertimental merge using the linear merge method. This is to assess the degree of which the DPO has an effect, in terms of censoring, as used in jondurbin/bagel-dpo-34b-v0.2.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: jondurbin/nontoxic-bagel-34b-v0.2
parameters:
weight: 0.5
- model: jondurbin/bagel-dpo-34b-v0.2
parameters:
weight: 0.5
merge_method: linear
dtype: float16