harshi173
/

Llama-3.2-1B-Instruct-bnb-4bit-QtoJ_GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

harshi173 commited on 3 days ago

Commit

8192f94

•

1 Parent(s): 92b7a5d

(Trained with Unsloth)

Files changed (1) hide show

Modelfile +1 -1

Modelfile CHANGED Viewed

@@ -1,5 +1,5 @@
-FROM /content/harshi173/Llama-3.2-1B-Instruct-bnb-4bit-QtoJ_GGUF/unsloth.Q8_0.gguf
 TEMPLATE """{{ if .Messages }}
 {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|>
 {{- if .System }}

+FROM /content/harshi173/Llama-3.2-1B-Instruct-bnb-4bit-QtoJ_GGUF/unsloth.F16.gguf
 TEMPLATE """{{ if .Messages }}
 {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|>
 {{- if .System }}