Update README.md
Browse files
README.md
CHANGED
@@ -21,6 +21,16 @@ pipeline_tag: summarization
|
|
21 |
- **License:** apache-2.0
|
22 |
- **Finetuned from model :** unsloth/Qwen2-1.5b-bnb-4bit
|
23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
25 |
|
26 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
21 |
- **License:** apache-2.0
|
22 |
- **Finetuned from model :** unsloth/Qwen2-1.5b-bnb-4bit
|
23 |
|
24 |
+
# Inference LlamaCpp
|
25 |
+
|
26 |
+
```sh
|
27 |
+
llama-cli \
|
28 |
+
--hf-repo "ClarityClips/ClarityQwen2Summarizer" \
|
29 |
+
--hf-file unsloth.Q4_K_M.gguf \
|
30 |
+
-p "Nihilism: The Philosophy of Johan Liebert, the Tenma's Influence. Summary: " \
|
31 |
+
-n 700
|
32 |
+
```
|
33 |
+
|
34 |
This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
35 |
|
36 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|