LnL-AI
/

dbrx-base-converted-v2-4bit-gptq-marlin-v2

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Apr 2, 2024

Commit

4b30256

·

verified ·

1 Parent(s): 40dd57f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@
 4bit gptq (marlin) version of dbrx-base-converted-v2
-Version: 2 (much better than quantization/calibration than previous)
 Run:
 1. Use PR https://github.com/AutoGPTQ/AutoGPTQ/pull/625

 4bit gptq (marlin) version of dbrx-base-converted-v2
+Version: 2 (much better quantization/calibration than previous)
 Run:
 1. Use PR https://github.com/AutoGPTQ/AutoGPTQ/pull/625