uploaded readme

0efe7cd verified 5 months ago

4.69 kB

	Quantization made by Richard Erkhov.

	[Github](https://github.com/RichardErkhov)

	[Discord](https://discord.gg/pvy7H8DZMG)

	[Request more models](https://github.com/RichardErkhov/quant_request)


	Qwen-uncensored-v2 - GGUF
	- Model creator: https://huggingface.co./Xennon-BD/
	- Original model: https://huggingface.co./Xennon-BD/Qwen-uncensored-v2/


	\| Name \| Quant method \| Size \|
	\| ---- \| ---- \| ---- \|
	\| [Qwen-uncensored-v2.Q2_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q2_K.gguf) \| Q2_K \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_XS.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_XS.gguf) \| IQ3_XS \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_S.gguf) \| IQ3_S \| 0.32GB \|
	\| [Qwen-uncensored-v2.Q3_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_S.gguf) \| Q3_K_S \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_M.gguf) \| IQ3_M \| 0.32GB \|
	\| [Qwen-uncensored-v2.Q3_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K.gguf) \| Q3_K \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q3_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_M.gguf) \| Q3_K_M \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q3_K_L.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_L.gguf) \| Q3_K_L \| 0.34GB \|
	\| [Qwen-uncensored-v2.IQ4_XS.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ4_XS.gguf) \| IQ4_XS \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q4_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_0.gguf) \| Q4_0 \| 0.33GB \|
	\| [Qwen-uncensored-v2.IQ4_NL.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ4_NL.gguf) \| IQ4_NL \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q4_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K_S.gguf) \| Q4_K_S \| 0.36GB \|
	\| [Qwen-uncensored-v2.Q4_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K.gguf) \| Q4_K \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q4_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K_M.gguf) \| Q4_K_M \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q4_1.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_1.gguf) \| Q4_1 \| 0.35GB \|
	\| [Qwen-uncensored-v2.Q5_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_0.gguf) \| Q5_0 \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q5_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K_S.gguf) \| Q5_K_S \| 0.38GB \|
	\| [Qwen-uncensored-v2.Q5_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K.gguf) \| Q5_K \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q5_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K_M.gguf) \| Q5_K_M \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q5_1.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_1.gguf) \| Q5_1 \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q6_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q6_K.gguf) \| Q6_K \| 0.47GB \|
	\| [Qwen-uncensored-v2.Q8_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q8_0.gguf) \| Q8_0 \| 0.49GB \|




	Original model description:
	---
	base_model: unsloth/Qwen2-0.5b-bnb-4bit
	language:
	- en
	license: apache-2.0
	tags:
	- text-generation-inference
	- transformers
	- unsloth
	- qwen2
	- trl
	- sft
	---

	# Uploaded model

	- Developed by: ar08
	- License: apache-2.0
	- Finetuned from model : unsloth/Qwen2-0.5b-bnb-4bit

	This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

	[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)

	Quantization made by Richard Erkhov.

	[Github](https://github.com/RichardErkhov)

	[Discord](https://discord.gg/pvy7H8DZMG)

	[Request more models](https://github.com/RichardErkhov/quant_request)


	Qwen-uncensored-v2 - GGUF
	- Model creator: https://huggingface.co./Xennon-BD/
	- Original model: https://huggingface.co./Xennon-BD/Qwen-uncensored-v2/


	\| Name \| Quant method \| Size \|
	\| ---- \| ---- \| ---- \|
	\| [Qwen-uncensored-v2.Q2_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q2_K.gguf) \| Q2_K \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_XS.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_XS.gguf) \| IQ3_XS \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_S.gguf) \| IQ3_S \| 0.32GB \|
	\| [Qwen-uncensored-v2.Q3_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_S.gguf) \| Q3_K_S \| 0.32GB \|
	\| [Qwen-uncensored-v2.IQ3_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ3_M.gguf) \| IQ3_M \| 0.32GB \|
	\| [Qwen-uncensored-v2.Q3_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K.gguf) \| Q3_K \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q3_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_M.gguf) \| Q3_K_M \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q3_K_L.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q3_K_L.gguf) \| Q3_K_L \| 0.34GB \|
	\| [Qwen-uncensored-v2.IQ4_XS.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ4_XS.gguf) \| IQ4_XS \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q4_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_0.gguf) \| Q4_0 \| 0.33GB \|
	\| [Qwen-uncensored-v2.IQ4_NL.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.IQ4_NL.gguf) \| IQ4_NL \| 0.33GB \|
	\| [Qwen-uncensored-v2.Q4_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K_S.gguf) \| Q4_K_S \| 0.36GB \|
	\| [Qwen-uncensored-v2.Q4_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K.gguf) \| Q4_K \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q4_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_K_M.gguf) \| Q4_K_M \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q4_1.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q4_1.gguf) \| Q4_1 \| 0.35GB \|
	\| [Qwen-uncensored-v2.Q5_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_0.gguf) \| Q5_0 \| 0.37GB \|
	\| [Qwen-uncensored-v2.Q5_K_S.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K_S.gguf) \| Q5_K_S \| 0.38GB \|
	\| [Qwen-uncensored-v2.Q5_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K.gguf) \| Q5_K \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q5_K_M.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_K_M.gguf) \| Q5_K_M \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q5_1.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q5_1.gguf) \| Q5_1 \| 0.39GB \|
	\| [Qwen-uncensored-v2.Q6_K.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q6_K.gguf) \| Q6_K \| 0.47GB \|
	\| [Qwen-uncensored-v2.Q8_0.gguf](https://huggingface.co./RichardErkhov/Xennon-BD_-_Qwen-uncensored-v2-gguf/blob/main/Qwen-uncensored-v2.Q8_0.gguf) \| Q8_0 \| 0.49GB \|




	Original model description:
	---
	base_model: unsloth/Qwen2-0.5b-bnb-4bit
	language:
	- en
	license: apache-2.0
	tags:
	- text-generation-inference
	- transformers
	- unsloth
	- qwen2
	- trl
	- sft
	---

	# Uploaded model

	- Developed by: ar08
	- License: apache-2.0
	- Finetuned from model : unsloth/Qwen2-0.5b-bnb-4bit

	This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

	[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)