Uploaded model

Developed by: NextG lab@ NC State
License: apache-2.0

Note: This only contains the LoRA adapter and the Tokenizer obtained by leveraging QLoRA with AQLM

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Examples

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for prnshv/ORANSight_Mixtral_8x7B_Instruct_AQLM

Base model

ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Finetuned

(1)

this model

Collection including prnshv/ORANSight_Mixtral_8x7B_Instruct_AQLM

ORANSight-1.0: Mistral

Collection

All the Mistral models belonging to the first release of the ORANSight family of models from the NextG Lab@ NCSU • 4 items • Updated 10 days ago