rocket-3B-GGUF

Runtime error

rocket-3B-GGUF / README.md

feat: added chat_format and update Q6_K model

a5c9525 12 months ago

347 Bytes

	---
	title: rocket-3B-GGUF (Q6_K)
	colorFrom: purple
	colorTo: blue
	sdk: docker
	models:
	- pansophic/rocket-3B
	- TheBloke/rocket-3B-GGUF
	tags:
	- inference api
	- openai-api compatible
	- llama-cpp-python
	- rocket-3B-GGUF
	- gguf
	pinned: false
	---

	# rocket-3B-GGUF (Q6_K)

	Please refer to the [index.html](index.html) for more information.