irotem98
/

qwen_test2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

qwen_test2 / mergekit_config.yml

irotem98's picture

Upload folder using huggingface_hub

47f64e3 verified 2 days ago

history blame contribute delete

768 Bytes

	merge_method: passthrough
	slices:
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [0, 2]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [4, 5]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [7, 8]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [10, 11]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [13, 14]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [16, 17]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [19, 20]
	- sources:
	- model: Qwen/Qwen2.5-0.5B-Instruct
	layer_range: [22, 24]
	dtype: float16
	tokenizer_source: Qwen/Qwen2.5-0.5B-Instruct