Hugging Face's logo

Delta-Vector
/
Holland-4B-V1

Safetensors
llama
chat
Model card Files Community
1
Delta-Vector commited on
Commit
1887403
•
1 Parent(s): e69de54

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -16,9 +16,18 @@ tags:
16
  - chat
17
  ---
18
 
 
 
19
  ![image/png](https://huggingface.co/Edens-Gate/Testing123/resolve/main/oie_gM9EsNXjMDsT.jpg?download=true)
20
  A model made to continue off my previous work on [Magnum 4B](https://huggingface.co/anthracite-org/magnum-v2-4b), A small model made for creative writing / General assistant tasks, finetuned ontop of [IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml](https://huggingface.co/IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml), this model is made to be more coherent and generally be better then the 4B at both writing and assistant tasks.
21
 
 
 
 
 
 
 
 
22
  ## Prompting
23
  Model has been Instruct tuned with the ChatML formatting. A typical input would look like this:
24
 
 
16
  - chat
17
  ---
18
 
19
+
20
+
21
  ![image/png](https://huggingface.co/Edens-Gate/Testing123/resolve/main/oie_gM9EsNXjMDsT.jpg?download=true)
22
  A model made to continue off my previous work on [Magnum 4B](https://huggingface.co/anthracite-org/magnum-v2-4b), A small model made for creative writing / General assistant tasks, finetuned ontop of [IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml](https://huggingface.co/IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml), this model is made to be more coherent and generally be better then the 4B at both writing and assistant tasks.
23
 
24
+ # Quants (Thanks Lucy <3)
25
+
26
+ GGUF: https://huggingface.co/NewEden/Holland-4B-gguf
27
+
28
+ EXL2: https://huggingface.co/NewEden/Holland-4B-exl2
29
+
30
+
31
  ## Prompting
32
  Model has been Instruct tuned with the ChatML formatting. A typical input would look like this:
33