Rombos-LLM-V2.5-Qwen-72b / mergekit_config.yml
rombodawg's picture
Duplicate from Replete-AI/Replete-LLM-V2.5-Qwen-72b
5260f18 verified
raw
history blame contribute delete
177 Bytes
models:
- model: ./qwen-72b-instruct
parameters:
weight: 1
merge_method: ties
base_model: ./qwen-72b
parameters:
normalize: true
int8_mask: true
dtype: bfloat16