Upload folder using huggingface_hub (#1)

- 3fc229b76f26babc2d481cb53f4f4b248e9d2e26182d1fad9f37048ef2ca0563 (ef8b3c9d8059d84fcc2f75339e15ffeefd7c02b4)
- 4dd00ee1e446d844c84011e41ed7262b15973e1df2c381d530b929bfdd2bc309 (ba9f8fd48ff84c6f4dfb5d68d7a01d53919a682d)
- fba5f1b1a7f5b6f3f2887867ad953e9ffbb5929404ef2992ded128bf0ca8d9d3 (c7f8ff21bd9fe0084a7aa4eae95564c0ee8ebf0f)
- c9f474f9ecdcc424a171676a4a82318a9ebfeb362f2c85330c403145a3e09138 (fa8a83f3c03c266d2594932723be6b46b9c8e337)
- abe165663af2d8e36ccbb4bbed9dcc60ee2ca04be183ccd6dc5a98bbcfebd7b5 (a98461f86ba5e780aa0d4d5daeac565eae987b3e)
- a0543f98887baa42fbe35facad5207a1cac22eea1d81149f1025370a14fc1d13 (1348b08d96aeab58ae86a94b74d227b852e41bff)
- 7b0097fcb76b2bef1d77968f339c68bbe47bb058f9cb0e6554f8aab4fad958d6 (e27447eb6964777a5c3c25b6feee9e8856dafc45)
- c65ab8af13b7387c0be6a2a569dd3e82138c7020e85ecd2b89fbd941e74efa90 (51e39c794415776aafe00063677197b32ac12bd9)
- e03c866fb6e096271e590bb61faa342bc575575634cf16bd232ccf5ec115a669 (b7aec9e4ec8751912ca2f60037f0aa0a55ab0e28)
- 325da0e9b770e31df0509ff02dd337a4d56ce0165b8cfdc7e4618fe74598636c (32fc81f73a66107af54c2dffb7c77d42d86d5b2b)
- 4282e35ac4b053559e189ee13af1236ac28c0af21f879b9d774dc18de493bfaf (aee441066e8095d1cda01c6754a8d03e0e2581ba)

.gitattributes

@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+TopEvolutionWiz.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,57 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- mistral
+- text-generation
+- mergekit
+- merge
+- base_model:mergekit-community/TopEvolution
+- base_model:lucyknada/microsoft_WizardLM-2-7B
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: TopEvolutionWiz-GGUF
+base_model: mergekit-community/TopEvolutionWiz
+inference: false
+model_creator: mergekit-community
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/TopEvolutionWiz-GGUF](https://huggingface.co/MaziyarPanahi/TopEvolutionWiz-GGUF)
+- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
+- Original model: [mergekit-community/TopEvolutionWiz](https://huggingface.co/mergekit-community/TopEvolutionWiz)
+
+## Description
+[MaziyarPanahi/TopEvolutionWiz-GGUF](https://huggingface.co/MaziyarPanahi/TopEvolutionWiz-GGUF) contains GGUF format model files for [mergekit-community/TopEvolutionWiz](https://huggingface.co/mergekit-community/TopEvolutionWiz).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

TopEvolutionWiz.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9636b6876af0e05f0c8106caf0cfb55a10a45bb47a433df03a35840d235ec1c8
+size 2719242080

TopEvolutionWiz.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c72876e651bb3b3b2cdeb17213b5f34981980f3843b62d18a8ae36725b75229
+size 3822024544

TopEvolutionWiz.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5084ac9e09be6e81f5265a9f94af93c648e98e3624498f609659641039346d5
+size 3518986080

TopEvolutionWiz.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42ced0d95ff9183907ebe8b78baa36c2f5f1339c54cd0041f7ce2f9fd888dbc0
+size 3164567392

TopEvolutionWiz.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:27e94bfc0587913b38f89e8343146d94ac92befdda5f264869b01740556a824c
+size 4368439136

TopEvolutionWiz.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d2f918b564a7c2971fd66638663670eecd3a4d5409af53ed6af37b18229ea79
+size 4140373856

TopEvolutionWiz.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ff382bf6966065d7ee52011d243f5a8105796d24286ccd2b8f08845fcf3c558
+size 5131409248

TopEvolutionWiz.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40460baeaa742c3f61a55cb30fc2a3259e92406ee3b938ba1aac2a467bb1b3eb
+size 4997715808

TopEvolutionWiz.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32cb119e9802c3801b70bc5fe051ac28f86395a1b72dcbf84f1cff34c88b432d
+size 5942064992

TopEvolutionWiz.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e06636fe539b305192f90337f2b89a460b78ae245362cfadbc0cff8650a40db
+size 7695857504