chenghenry
/

gemma-2-27b-it-GGUF

Inference Endpoints

Model card Files Files and versions Community

chenghenry commited on Jul 5

Commit

7e4f32e

•

1 Parent(s): 0fd5b3b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ base_model: google/gemma-2-27b-it
 ## Usage (llama-cli with GPU):
 ```
-llama-cli -m ./gemma-2-27b-it-IQ3_M.gguf -ngl 100 --temp 0 --repeat-penalty 1.0 --color -p "Why is the sky blue?"
 ```
 ## Usage (llama-cli with CPU):

 ## Usage (llama-cli with GPU):
 ```
+llama-cli -m ./gemma-2-27b-it-IQ3_M.gguf -ngl 42 --temp 0 --repeat-penalty 1.0 --color -p "Why is the sky blue?"
 ```
 ## Usage (llama-cli with CPU):