Update README.md

README.md

@@ -20,6 +20,17 @@ This model is a fine-tuned version of [google/gemma-2-9b-it](https://huggingface
 fully annotated by humans only, on the English version of the <ins>*DiTy/function-calling*</ins> dataset.
 <!-- Provide a quick summary of what the model is/does. -->
 
+In addition to **safetensors**, the model is available in **GGUF** formats (in this case, you need to download only a single file):
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [gemma-2-9B-it-function-calling-F16.gguf](https://huggingface.co/DiTy/gemma-2-9b-it-function-calling/blob/main/gemma-2-9B-it-function-calling-F16.gguf) | F16 | 18.5GB | Base model with float16 |
+| [gemma-2-9B-it-function-calling-Q8_0.gguf](https://huggingface.co/DiTy/gemma-2-9b-it-function-calling/blob/main/gemma-2-9B-it-function-calling-Q8_0.gguf) | Q8_0 | 9.83GB | Extremely high quality, generally unneeded but max available quant. |
+| [gemma-2-9B-it-function-calling-Q6_K.gguf](https://huggingface.co/DiTy/gemma-2-9b-it-function-calling/blob/main/gemma-2-9B-it-function-calling-Q6_K.gguf) | Q6_K | 7.59GB | Very high quality, near perfect, *recommended*. |
+| [gemma-2-9B-it-function-calling-Q5_K_M.gguf](https://huggingface.co/DiTy/gemma-2-9b-it-function-calling/blob/main/gemma-2-9B-it-function-calling-Q5_K_M.gguf) | Q5_K_M | 6.65GB | High quality, very usable. |
+| [gemma-2-9B-it-function-calling-Q5_K_S.gguf](https://huggingface.co/DiTy/gemma-2-9b-it-function-calling/blob/main/gemma-2-9B-it-function-calling-Q5_K_S.gguf) | Q5_K_S | 6.48GB | High quality, very usable. |
+
+
 ## Model card tree
 
 * [How prepare your functions (tools) for *Function Calling*](#prepare_func_call)