Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Qwama-0.5B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Qwama-0.5B-Instruct-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:044be25fd6608902c1993ae24eeacfac6a17c3ec97322c6d241acd7476dace49
+size 317951104

Qwama-0.5B-Instruct-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75b59a9eb17b3aed17fb1b326c5fa8344abb110e0abb781988e7fa1d58c8a4ee
+size 348701824

Qwama-0.5B-Instruct-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e539629c34ebc7a4a77ab4fa920d29115f41b416be9add81b692e1b8066d1b87
+size 334810240

Qwama-0.5B-Instruct-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afadc3b95535dc9a38456de7b8412ab1a3898bc0381a7a7d4da3b388cad2ffbe
+size 317607040

Qwama-0.5B-Instruct-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c87b5cc5ce763cf064ec00358701cec75236693abbd4ee8e53e5d980d2b37ad
+size 331498624

Qwama-0.5B-Instruct-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18ec0048231619a2a51d8a58460df8987dab74af30352aaf77d3ed5b49c96f52
+size 377151616

Qwama-0.5B-Instruct-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:518fb1b3019c0e65c6e989c3fa7c6cfdcc54eb4ae5d6877389837325e4546471
+size 364815488

Qwama-0.5B-Instruct-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0b22585a2ac63909f0c2f5b0d49c71ed20b09e6ff08afc375cbdbc2b4423df5
+size 376226944

Qwama-0.5B-Instruct-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d0e5e1e3a40cd7ac1eb254aa2e46d459e5fe71a6f62d3bb19cf27cdac46fb84
+size 399429760

Qwama-0.5B-Instruct-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee1c002ef93c2386df17e6095642c852e9a61073878100bd4ea0bc7ed8d8c77f
+size 392053888

Qwama-0.5B-Instruct-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa889ae5792d8e2fe21a46ab0fc81cd50bb95cb58dd183a785f442cfec39a149
+size 485080192

Qwama-0.5B-Instruct-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de463f1c515532bdc735e16daea4bbfe3e9a8f113ba4bcc484b58927f25a21e5
+size 510411904

README.md

@@ -0,0 +1,74 @@
+---
+license: apache-2.0
+base_model: turboderp/Qwama-0.5B-Instruct
+tags:
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## turboderp/Qwama-0.5B-Instruct - GGUF
+
+This repo contains GGUF format model files for [turboderp/Qwama-0.5B-Instruct](https://huggingface.co/turboderp/Qwama-0.5B-Instruct).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>
+
+{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
+
+{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Qwama-0.5B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q2_K.gguf) | Q2_K | 0.296 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Qwama-0.5B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.296 GB | very small, high quality loss |
+| [Qwama-0.5B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.312 GB | very small, high quality loss |
+| [Qwama-0.5B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.325 GB | small, substantial quality loss |
+| [Qwama-0.5B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q4_0.gguf) | Q4_0 | 0.309 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Qwama-0.5B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.340 GB | small, greater quality loss |
+| [Qwama-0.5B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.351 GB | medium, balanced quality - recommended |
+| [Qwama-0.5B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q5_0.gguf) | Q5_0 | 0.350 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Qwama-0.5B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q5_K_S.gguf) | Q5_K_S | 0.365 GB | large, low quality loss - recommended |
+| [Qwama-0.5B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q5_K_M.gguf) | Q5_K_M | 0.372 GB | large, very low quality loss - recommended |
+| [Qwama-0.5B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q6_K.gguf) | Q6_K | 0.452 GB | very large, extremely low quality loss |
+| [Qwama-0.5B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Qwama-0.5B-Instruct-GGUF/tree/main/Qwama-0.5B-Instruct-Q8_0.gguf) | Q8_0 | 0.475 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Qwama-0.5B-Instruct-GGUF --include "Qwama-0.5B-Instruct-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Qwama-0.5B-Instruct-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```