A good 7B quant

#1
by aaha - opened

@MaziyarPanahi One request - Could you also quant the Samantha westlake that has been released? https://huggingface.co./cognitivecomputations/samantha-1.1-westlake-7b

Thanks!

Hi @aaha
Sure, here are the quant models for samantha-1.1-westlake-7b:

I love the models coming out of cognitivecomputations! :)

Sign up or log in to comment