danielus commited on
Commit
a1ea34b
1 Parent(s): a6ec4c2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - llama-cpp
5
+ ---
6
+
7
+ # danielus/MermaidMixtral-3x7b-Q6_K-GGUF
8
+ This model was converted to GGUF format from [`TroyDoesAI/MermaidMixtral-3x7b`](https://huggingface.co/TroyDoesAI/MermaidMixtral-3x7b) using llama.cpp.
9
+ Refer to the [original model card](https://huggingface.co/TroyDoesAI/MermaidMixtral-3x7b) for more details on the model.
10
+ ## Use with llama.cpp
11
+
12
+ ```bash
13
+ brew install ggerganov/ggerganov/llama.cpp
14
+ ```
15
+
16
+ ```bash
17
+ llama-cli --hf-repo danielus/MermaidMixtral-3x7b-Q6_K-GGUF --model mermaidmixtral-3x7b.Q6_K.gguf -p "The meaning to life and the universe is "
18
+ ```
19
+
20
+ ```bash
21
+ llama-server --hf-repo danielus/MermaidMixtral-3x7b-Q6_K-GGUF --model mermaidmixtral-3x7b.Q6_K.gguf -c 2048
22
+ ```