Upload README.md
Browse files
README.md
CHANGED
@@ -198,7 +198,7 @@ Windows Command Line users: You can set the environment variable by running `set
|
|
198 |
Make sure you are using `llama.cpp` from commit [d0cee0d](https://github.com/ggerganov/llama.cpp/commit/d0cee0d36d5be95a0d9088b674dbb27354107221) or later.
|
199 |
|
200 |
```shell
|
201 |
-
./main -ngl 32 -m alma-13b-pretrain.Q4_K_M.gguf --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "Translate this from Chinese to English
|
202 |
```
|
203 |
|
204 |
Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|
|
|
198 |
Make sure you are using `llama.cpp` from commit [d0cee0d](https://github.com/ggerganov/llama.cpp/commit/d0cee0d36d5be95a0d9088b674dbb27354107221) or later.
|
199 |
|
200 |
```shell
|
201 |
+
./main -ngl 32 -m alma-13b-pretrain.Q4_K_M.gguf --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "Translate this from Chinese to English:\nChinese: {prompt}\nEnglish:"
|
202 |
```
|
203 |
|
204 |
Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|