Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
casperhansen
/
mpt-7b-8k-chat-awq-gemv
like
0
Text Generation
Transformers
mpt
custom_code
4-bit precision
awq
License:
llama2
Model card
Files
Files and versions
Community
Train
Use this model
1f39a71
mpt-7b-8k-chat-awq-gemv
/
quant_config.json
casperhansen
initial
ede1189
about 1 year ago
raw
Copy download link
history
blame
Safe
90 Bytes
{
"zero_point"
:
true
,
"q_group_size"
:
128
,
"w_bit"
:
4
,
"version"
:
"GEMV"
}