exui error - 'intermediate_size' on gptq-3bit-128g-actorder_True

#3
by AgileTurnip - opened

Unable to load in exui, I get this error:

image.png

model https://huggingface.co./TheBloke/Falcon-180B-GPTQ with gptq-3bit-128g-actorder_True

@AgileTurnip i believe exllamav2 which exui uses does not support falcon models

Sign up or log in to comment