akaistormherald
/

ToxicMist-v0.2-7B-DPO-LORA

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

akaistormherald commited on Mar 5

Commit

8037b2d

•

1 Parent(s): 4eafab6

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -18,4 +18,7 @@ datasets:
 - **Developed by:** akaistormherald
 - **License:** apache-2.0
 - **Finetuned from model :** unsloth/zephyr-sft-bnb-4bit
-- 4bit DPO training from unalignment/toxic-dpo-v0.2, using unsloth

 - **Developed by:** akaistormherald
 - **License:** apache-2.0
 - **Finetuned from model :** unsloth/zephyr-sft-bnb-4bit
+ Mistral7b + SFT + 4bit DPO training with unalignment/toxic-dpo-v0.2 == ToxicMist? ☣🌫
+(qLORA version)