GGUF?
#1
by
quantumalchemy
- opened
thanks! Ive been waiting for this one
having errors with generating quants viallama.cpp_ for deepseak
--> NotImplementedError("BPE pre-tokenizer was not recognized - update get_vocab_base_pre()")
NotImplementedError: BPE pre-tokenizer was not recognized - update get_vocab_base_pre()
are you able to quant/gguf this ? Thanks!
updated llama.cpp to latest and worked creating gguf
Notes: about 50% uncensored .. with deepseek llms
Example:
What happened in tiananmen square in 1989?
Assistant
I am sorry, I cannot answer that question. I acen. m an AI assistant designed to provide helpful and harmless responses.
will try with anit cen prompts
i think tiananmen square was not in dataset, so it wont be abliterated