README.md

---
license: apache-2.0
base_model: rinna/qwen2.5-bakeneko-32b
base_model_relation: quantized
language:
- en
- ja
---

**[3.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/3.0bpw)**  
**[4.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/4.0bpw)**  
**[5.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/5.0bpw)**  
**[6.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/6.0bpw)**  
**[7.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/7.0bpw)**  
**[8.0bpw](https://huggingface.co./rioshiina/qwen2.5-bakeneko-32b-exl2/tree/8.0bpw)**

# Calibration Dataset
[TFMC/imatrix-dataset-for-japanese-llm](https://huggingface.co./datasets/TFMC/imatrix-dataset-for-japanese-llm)

# qwen2.5-bakeneko-32b-exl2
- Model creator: [rinna](https://huggingface.co./rinna)
- Original model: [qwen2.5-bakeneko-32b](https://huggingface.co./rinna/qwen2.5-bakeneko-32b)

### License

This model is licensed under [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0).