Tejasram's picture

6

Tejasram

Tejasram

·

tejasram2003

AI & ML interests

None yet

Organizations

None yet

Tejasram's activity

New activity in PrunaAI/Mixtral-8x22B-v0.1-bnb-4bit-smashed 6 months ago

Import error with bitsandbytes

#3 opened 6 months ago by

New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 9 months ago

OSError: mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.

#1 opened 9 months ago by

New activity in TheBloke/Mistral-7B-Instruct-v0.2-AWQ 9 months ago

Can we add a system message in the prompt template?

#3 opened 9 months ago by

New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 9 months ago

You are using a model of type mixtral_aqlm to instantiate a model of type mixtral. This is not supported for all configurations of models and can yield errors.

#3 opened 9 months ago by

Loading Model on AWS G5.4xlarge Instance Results in 'killed' Message

#2 opened 9 months ago by

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 9 months ago

Failure in loading the model on AWS

#88 opened 10 months ago by