What is this?
#1
by
vdruts
- opened
LOL. What is this based on?
Updated the model card with more info. Err.. apologies.
GPTQ 4bit planned?
edit: found it here
https://huggingface.co./Aeala/GPT4-x-AlpacaDente-30b-4bit
Hmm, can't seem to load it in Ooba with the latest GPTQ
GPTQ 4bit planned?
edit: found it here
https://huggingface.co./Aeala/GPT4-x-AlpacaDente-30b-4bit
That's a different version. It's pretty good. I'll also upload 4bit shortly.
Here you go. https://huggingface.co./MetaIX/GPT4-X-Alpasta-30b-4bit/tree/main Uploading 128g/ggml q4_1+2+3 soon