Update README.md

README.md

@@ -1,3 +1,38 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+base_model:
+- Qwen/Qwen2-VL-7B-Instruct
+pipeline_tag: image-text-to-text
+language:
+- en
+tags:
+- multimodal
+- conversational
+---
+
+# Qwen2-VL-2B-Instruct-GGUF (f16)
+This is a F16 GGUF version of [Qwen2-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct) for use with llama.cpp (i.e. you can run Qwen2-VL on your Mac)
+
+# How to Use
+1. Build `llama-qwen2vl-cli` executable
+2. Download model files and use: `./llama-qwen2vl-cli -m Qwen2-VL-2B-Instruct-F16.gguf --mmproj qwen2-vl-2b-instruct-vision.gguf -p "Describe this image." --image crocodiles.png`
+
+## Details on Usage:
+1. **Download the model files from this repository** (sidrajaram/Qwen2-VL-2B-Instruct-GGUF). 
+
+2. Make sure you have **[llama.cpp](https://github.com/ggerganov/llama.cpp)** and have built the **`llama-qwen2vl-cli`** executable.
+```
+git clone https://github.com/ggerganov/llama.cpp.git
+```
+For example, building with CMake (see detailed llama.cpp build instructions: https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md):
+```
+cmake -B build
+cmake --build build --config Release
+```
+3. **Run**
+```
+./path/to/llama-qwen2vl-cli -m path/to/Qwen2-VL-2B-Instruct-F16.gguf --mmproj path/to/qwen2-vl-2b-instruct-vision.gguf -p "Describe this image." --image path/to/image.png
+```
+
+
+**Credit to the original model**: https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct