ONS-AI-RESEARCH
/

ONS-SOLAR-10.7B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

ONS-SOLAR-10.7B-AWQ

Model Details

Base Model: ONS-AI-RESEARCH/ONS-SOLAR-10.7B
Quantization by AutoAWQ(https://github.com/casper-hansen/AutoAWQ)

Downloads last month: 11

Safetensors

Model size

1.74B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Collection including ONS-AI-RESEARCH/ONS-SOLAR-10.7B-AWQ

LLM

4 items • Updated Jul 29