rombodawg
/

Rombos-LLM-V2.5-Qwen-7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Rombos-LLM-V2.5-Qwen-7b / mergekit_config.yml

rombodawg's picture

Upload mergekit_config.yml with huggingface_hub

6bee411 verified 11 days ago

242 Bytes

	models:
	- model: Qwen_Qwen2.5-7B-Instruct
	parameters:
	weight: 1
	density: 1
	merge_method: ties
	base_model: Qwen_Qwen2.5-7B
	parameters:
	weight: 1
	density: 1
	normalize: true
	int8_mask: true
	dtype: bfloat16