Update README.md
Browse files
README.md
CHANGED
@@ -33,10 +33,11 @@ Q_6_K is good also; if you want a better result; take this one instead of Q_5_K_
|
|
33 |
|
34 |
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
|
35 |
|
36 |
-
f16 is similar to the original hf model; opt this or hf also fine; make sure you have a good machine
|
37 |
|
38 |
### how to run it
|
39 |
|
40 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
41 |
|
42 |
-
<img src="https://allenai.org/olmo/olmo-7b-animation.gif" alt="OLMo Logo" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
|
|
|
33 |
|
34 |
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
|
35 |
|
36 |
+
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
|
37 |
|
38 |
### how to run it
|
39 |
|
40 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
41 |
|
42 |
+
<img src="https://allenai.org/olmo/olmo-7b-animation.gif" alt="OLMo Logo" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
43 |
+
this picture is from the base model
|