Update README.md

README.md

@@ -33,6 +33,29 @@ Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9g
 * **Q6_K:** Uses Q8_K for all tensors
 * **Q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users.
 
+### Ollama Modfile
+The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-11B-v2.2-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like:
+
+```
+FROM ./Bielik-11B-v2.2-Instruct.Q4_K_M.gguf
+
+TEMPLATE """<s>{{ if .System }}<|start_header_id|>system<|end_header_id|>
+
+{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
+
+{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
+
+{{ .Response }}<|eot_id|>"""
+
+PARAMETER stop "<|start_header_id|>"
+PARAMETER stop "<|end_header_id|>"
+PARAMETER stop "<|eot_id|>"
+
+# Remeber to set low temperature for experimental models (1-3bits)
+PARAMETER temperature 0.1
+
+```
+
 ### Model description:
 
 * **Developed by:** [SpeakLeash](https://speakleash.org/) & [ACK Cyfronet AGH](https://www.cyfronet.pl/)