Rombos-LLM-V2.5-Qwen-32b / mergekit_config.yml
rombodawg's picture
Duplicate from Replete-AI/Replete-LLM-V2.5-Qwen-32b
3f66d5f verified
raw
history blame
177 Bytes
models:
- model: ./qwen-32b-instruct
parameters:
weight: 1
merge_method: ties
base_model: ./qwen-32b
parameters:
normalize: true
int8_mask: true
dtype: bfloat16