Hugging Face's logo

solidrust
/
Llama-3-Orca-1.0-8B-AWQ

Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community

Locutusque/Llama-3-Orca-1.0-8B AWQ

image/png

Model Summary

I fine-tuned llama-3 8B on mainly SlimOrca, along with other datasets to improve performance in math, coding, and writing.

This model has great performance in writing and coding.

Conversational AI.

Downloads last month
10
Safetensors
Model size
1.98B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for solidrust/Llama-3-Orca-1.0-8B-AWQ

Base model

Locutusque/Llama-3-Orca-1.0-8B
Quantized
(1)
this model

Datasets used to train solidrust/Llama-3-Orca-1.0-8B-AWQ

Collection including solidrust/Llama-3-Orca-1.0-8B-AWQ