A good 7B quant
#1
by
aaha
- opened
@MaziyarPanahi One request - Could you also quant the Samantha westlake that has been released? https://huggingface.co./cognitivecomputations/samantha-1.1-westlake-7b
Thanks!
Hi
@aaha
Sure, here are the quant models for samantha-1.1-westlake-7b
:
- GGUF: https://huggingface.co./MaziyarPanahi/samantha-1.1-westlake-7b-GGUF
- AWQ: https://huggingface.co./MaziyarPanahi/samantha-1.1-westlake-7b-AWQ
- GPTQ: https://huggingface.co./MaziyarPanahi/samantha-1.1-westlake-7b-GPTQ
I love the models coming out of cognitivecomputations
! :)