Svngoku commited on
Commit
ff2941e
·
verified ·
1 Parent(s): 2197411

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -21,6 +21,16 @@ pipeline_tag: summarization
21
  - **License:** apache-2.0
22
  - **Finetuned from model :** unsloth/Qwen2-1.5b-bnb-4bit
23
 
 
 
 
 
 
 
 
 
 
 
24
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
25
 
26
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
21
  - **License:** apache-2.0
22
  - **Finetuned from model :** unsloth/Qwen2-1.5b-bnb-4bit
23
 
24
+ # Inference LlamaCpp
25
+
26
+ ```sh
27
+ llama-cli \
28
+ --hf-repo "ClarityClips/ClarityQwen2Summarizer" \
29
+ --hf-file unsloth.Q4_K_M.gguf \
30
+ -p "Nihilism: The Philosophy of Johan Liebert, the Tenma's Influence. Summary: " \
31
+ -n 700
32
+ ```
33
+
34
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
35
 
36
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)