ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf / model-00001-of-00003.safetensors

Commit History

correct dtype + new dispatch + tokenizer

5133b63

BlackSamorez commited on Feb 27

Upload MixtralForCausalLM

6bfb114
verified

BlackSamorez commited on Feb 17