TheBloke
/

starchat-beta-GPTQ

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (2)

Working in text-geration-webui, with a little surprise...

#8 opened over 1 year ago by

Got an unexpected keyword argument 'model_name_or_path'

#6 opened over 1 year ago by

is it possible to make this work with huggingface/text-generation-inference ?

#5 opened over 1 year ago by

gptq_model-4bit--1g.safetensors does not contain metadata.

#3 opened over 1 year ago by

FYI in case you're getting Spanish after the answer is complete

#2 opened over 1 year ago by

is this working properly?

#1 opened over 1 year ago by