Add fp8 and GGUF if possible for us poor hw guys
#1
by
ryg81
- opened
Add fp8 and GGUF if possible for us poor hw guys
https://huggingface.co./Clybius/Flex.1-alpha-Q4_K_M-GGUF
I tested this and it works quite well - am positively surprised actually :)
adding Fp8 in safetensors format https://huggingface.co./gmonsoon/Flex.1-alpha-Fp8