Lewdiculous
commited on
Commit
•
58bcc76
1
Parent(s):
b31244a
Update README.md
Browse files
README.md
CHANGED
@@ -15,5 +15,47 @@ tags:
|
|
15 |
|
16 |
Original model weights: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4-Vision-7B
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/5_Pr7t9cD4MBZRkJ4hwpF.png)
|
|
|
15 |
|
16 |
Original model weights: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4-Vision-7B
|
17 |
|
18 |
+
# Vision/multimodal capabilities:
|
19 |
+
|
20 |
+
<details><summary>
|
21 |
+
Click here to see how this would work in practice in a roleplay chat.
|
22 |
+
</summary>
|
23 |
+
|
24 |
+
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/qGO0nIfZVcyuio5J07sU-.jpeg)
|
25 |
+
|
26 |
+
</details><br>
|
27 |
+
|
28 |
+
<details><summary>
|
29 |
+
Click here to see what your SillyTavern Image Captions extension settings should look like.
|
30 |
+
</summary>
|
31 |
+
|
32 |
+
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UpXOnVrzvsMRYeqMaSOaa.jpeg)
|
33 |
+
|
34 |
+
</details><br>
|
35 |
+
|
36 |
+
**If you want to use vision functionality:**
|
37 |
+
|
38 |
+
* Make sure you are using the latest version of [KoboldCpp](https://github.com/LostRuins/koboldcpp).
|
39 |
+
|
40 |
+
To use the multimodal capabilities of this model, such as **vision**, you also need to load the specified **mmproj** file, you can get it [here](https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/blob/main/mmproj-model-f16.gguf), it's also hosted in this repository inside the **mmproj** folder.
|
41 |
+
|
42 |
+
* You can load the **mmproj** by using the corresponding section in the interface:
|
43 |
+
|
44 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UX6Ubss2EPNAT3SKGMLe0.png)
|
45 |
+
|
46 |
+
* For CLI users, you can load the **mmproj file** by adding the respective flag to your usual command:
|
47 |
+
|
48 |
+
```
|
49 |
+
--mmproj your-mmproj-file.gguf
|
50 |
+
```
|
51 |
+
|
52 |
+
# Quantization information:
|
53 |
+
|
54 |
+
**Steps performed:**
|
55 |
+
|
56 |
+
```
|
57 |
+
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
|
58 |
+
```
|
59 |
+
*Using the latest llama.cpp at the time.*
|
60 |
|
61 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/5_Pr7t9cD4MBZRkJ4hwpF.png)
|