---
base_model:
- deepseek-ai/DeepSeek-V3
---
Preview for the GGUF quantized version of [deepseek-ai/DeepSeek-V3](https://huggingface.co./deepseek-ai/DeepSeek-V3)

It needs this PR commit to work: https://github.com/ggerganov/llama.cpp/pull/11049

Thanks to Fairydreaming for the PR!