Hugging Face's logo

huihui-ai
/
Llama-3.1-Nemotron-70B-Instruct-HF-abliterated

Text Generation
Transformers
Safetensors
English
llama
nvidia
llama3.1
conversational
text-generation-inference
Model card Files Community
2

Nemotron 51b abliterated?

#2
by recallmenot - opened
Discussion
recallmenot
•
edited 2 days ago

Hi,
would it be possible to also abliterate the 51b version of nemotron?
It's quite useful for 2x 3090, allowing to run Q5KM with 28k context on the GPUs.

recallmenot changed discussion title from Nemotron 52b albliterated? to Nemotron 51b albliterated?
recallmenot changed discussion title from Nemotron 51b albliterated? to Nemotron 51b abliterated?
huihui-ai
 Owner

https://huggingface.co./nvidia/Llama-3_1-Nemotron-51B-Instruct ?

Sign up or log in to comment