Edit model card

This repository includes some of our favorite bonchon ('side dishes' in Korean).

We currently include in this repository several of our favorite GGUF files from TheBloke, including four of our favorite 7B chat models, in Q4_K_M GGUF files.

This repository is Public, but intended primarily for use in conjunction with other llmware models, datasets and libraries.

Please note specific licensing information and reference for files included in the repository:

  1. HuggingFaceH4/Zephyr-7B-GGUF - MIT License - original repository link
  2. Teknium/OpenHermes-2.5-Mistral-7B-GGUF - Apache 2.0 License - original repository link
  3. Llama2-Chat-7B-GGUF - Llama2 License - original repository link
  4. Starling-7B-GGUF - CC-BY-NC-4.0 License - Non-Commercial - original repository link
  5. EleutherAI/Llema-7B-GGUF - Apache 2.0 License - original repository link

Please also see TheBloke for more information on GGUF.

Downloads last month
335
GGUF
Model size
7.24B params
Architecture
llama

4-bit

Inference API
Unable to determine this model’s pipeline type. Check the docs .