city96

/

HunyuanVideo-gguf

like 86

this needs to happen! keep up the good work

would be great hopefully city96 sees the request

Combined with this project the video generation can go hard
https://x.com/YangL_7/status/1870116980717695243
https://oahzxl.github.io/Enhance_A_Video
https://github.com/NUS-HPC-AI-Lab/Enhance-A-Video

Please please please, GGUF of FastHunyuan!

Please please please, GGUF of FastHunyuan!

there is a fp8 version and i am using it hunyuan_video_FastVideo_720_fp8_e4m3fn.safetensors here https://huggingface.co./Kijai/HunyuanVideo_comfy/tree/main, i have not checked how fast it is vs the distill version.

i prefer GGUF Q8. Usually better than FP8

Please please please, GGUF of FastHunyuan!

there is a fp8 version and i am using it hunyuan_video_FastVideo_720_fp8_e4m3fn.safetensors here https://huggingface.co./Kijai/HunyuanVideo_comfy/tree/main, i have not checked how fast it is vs the distill version.

It's 12GB against Q4 which requires only 8GB card. I also tried a Hunyuan's block swap node in ComfyUI to handle my 8GB limit, but got a crash on sampler stage.

can we please get the GGUF for fasthunyuan, fp8 doesnt work on macs

can we please get the GGUF for fasthunyuan, fp8 doesnt work on macs

dude please do gguf version of fasthunyuan, c'mon mahn can't wait anymore.

Sorry, been super busy with real life stuff. Anyway, uploaded them here: https://huggingface.co./city96/FastHunyuan-gguf

Only tested on single frame generation and probably with the wrong settings but it seems to work.

Sorry, been super busy with real life stuff. Anyway, uploaded them here: https://huggingface.co./city96/FastHunyuan-gguf

Only tested on single frame generation and probably with the wrong settings but it seems to work.

It works, THANK YOU! Tested on the same workflow on my laptop 4060 8GB (704x400, 61 frames) FastHunyuan Q4_K_S 6 steps ~2 minutes vs Hunyuan Q4_K_S 20 steps ~6 mins