Imran1
/

Qwen2.5-72B-Instruct-FP8

Model card Files Files and versions Community

Qwen2.5-72B-Instruct-FP8 / code /requirements.txt

Imran1's picture

Update code/requirements.txt

fd6d93c verified 14 days ago

142 Bytes

	vllm @ https://github.com/vllm-project/vllm/releases/download/v0.6.1.post1/vllm-0.6.1.post1+cu118-cp310-cp310-manylinux1_x86_64.whl
	accelerate