horangwave
/

vicuna_2230

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

vicuna_2230 / mergekit_config.yml

huh707's picture

layers 22~29 are pruned

a277fdb 6 months ago

186 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 22]
	model: lmsys/vicuna-7b-v1.3
	- sources:
	- layer_range: [30, 32]
	model: lmsys/vicuna-7b-v1.3