Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TitanML
/
Meta-Llama-3-8B-Instruct-Marlin-4bit
like
1
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
No model card
New: Create and edit this model card directly on the website!
Contribute a Model Card
Downloads last month
14
Safetensors
Model size
1.98B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.
Collection including
TitanML/Meta-Llama-3-8B-Instruct-Marlin-4bit
Llama
Collection
18 items
•
Updated
7 days ago