Any positive/negative prompts for merging?

#2
by adi-kmt - opened

Looked at https://huggingface.co./mlabonne/phixtral-4x2_8/discussions/6 and wanted to know if you added any pos/neg prompts?

I used positive prompts but no negative prompts. Doesn’t actually change the output with a random gate whatsoever until it’s trained, but can help the gate later on apparently. I’ll post the mergekit config

Added the yaml in Training-Configs folder. Closing thread!

Crystalcareai changed discussion status to closed

Thanks a lot!!

Sign up or log in to comment