Hugging Face's logo

neuralmagic
/
MiniChat-1.5-3B-pruned50-quant-ds

Text Generation
Transformers
ONNX
llama
deepsparse
Model card Files Community
mwitiderrick commited on
Commit
d807928
•
1 Parent(s): 2ed7dfd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ quantized_by: mwitiderrick
10
  tags:
11
  - deepsparse
12
  ---
13
- # MiniChat-3B - DeepSparse
14
  This repo contains model files for [MiniChat-1.5-3B](https://huggingface.co/GeneZC/MiniChat-1.5-3B) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
15
 
16
  This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
 
10
  tags:
11
  - deepsparse
12
  ---
13
+ # MiniChat-1.5-3B - DeepSparse
14
  This repo contains model files for [MiniChat-1.5-3B](https://huggingface.co/GeneZC/MiniChat-1.5-3B) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
15
 
16
  This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).