Bielik-11B-v2.1-Instruct-GPTQ

This repo contains GPTQ format model files for SpeakLeash's Bielik-11B-v.2.1-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Model description:

Responsible for model quantization

  • Remigiusz KinasSpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.

Downloads last month
5
Safetensors
Model size
1.72B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for speakleash/Bielik-11B-v2.1-Instruct-GPTQ

Quantized
(4)
this model

Collection including speakleash/Bielik-11B-v2.1-Instruct-GPTQ