Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Lucie-7B-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+lucie-7b-baby-instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+lucie-7b-baby-instruct.bf16.gguf filter=lfs diff=lfs merge=lfs -text

Lucie-7B-q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a1cd6d35594dbe3bfd240822adc85380cb3f2e333148e62a1b095a04669c717
+size 4068732096

README.md

@@ -0,0 +1,25 @@
+---
+license: apache-2.0
+tags:
+- autoquant
+- gguf
+---
+
+# Test in python
+
+* [test_transformers_gguf.py](test_transformers_gguf.py): Test GGUF model with `transformers` package (WARNING: loading the model is long)
+
+# Test with ollama
+
+* Download and install [Ollama](https://ollama.com/download)
+* Download the [GGUF model](https://huggingface.co/OpenLLM-France/Lucie-7B-Baby-Instruct/resolve/main/Lucie-7B-q4_k_m.gguf)
+* Copy the [`Modelfile`](Modelfile), adpating if necessary the path to the GGUF file (line starting with `FROM`).
+* Run in a shell:
+    * `ollama create -f Modelfile Lucie`
+    * `ollama run Lucie`
+* Once ">>>" appears, type your prompt(s) and press Enter.
+* Optionally, restart a conversation by typing "`/clear`"
+* End the session by typing "`/bye`".
+
+Useful for debug:
+* [How to print input requests and output responses in Ollama server?](https://stackoverflow.com/a/78831840)

lucie-7b-baby-instruct.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0470055fd05741ffb1a177b1c419c53b0add80816f9fa8db8e7e069738d89bd3
+size 2583915840

lucie-7b-baby-instruct.bf16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5afabaa1c397b5b83c61751fd8b1e5e5a2e9f35a5c36a4cc210a08a50a954c8d
+size 13416017216