Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
zgce
/
Yi-1.5-34B-Chat-GPTQ-Int8
like
1
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
gptq
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
This is the quantified
Yi-1.5-34B-Chat
model.
Downloads last month
194
Safetensors
Model size
9.62B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.