Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ChenMnZ
's Collections
EfficientQAT
EfficientQAT(w/o E2E-FT)
EfficientQAT(GPTQ format)
EfficientQAT (BitBLAS format)
EfficientQAT (BitBLAS format)
updated
Jul 22
EfficientQAT quantized models with BitBLAS data format.
Upvote
-
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
3
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
2
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
6
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
5
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
6
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
2
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
3
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
6
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
6
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
2
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
2
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
3
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
ChenMnZ/Llama-2-13b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22
•
2
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22
•
4
Upvote
-
Share collection
View history
Collection guide
Browse collections