"Small" "Medium" and "Large" models don't work on cloned repository

#40
by MantraDas - opened

I can get "Medlody" to work (which is fantastic and amazing), but Small, Medium, and Large do not work at all. Do I need to tweak the top-k, top-p, Tempature, and Free Guidance to get them to work?

Also, wondering if that terminology can be replaced with something more intuitive. "Top-K" means nothing to anyone without digging through the documentation, so a tooltip or re-naming of the parameter would be very nice. Feature request.

Also, I can't find the documentation about those parameters and such. Can you link to where the "Top-K" and stuff like that is documented so we can know what it does?

Sign up or log in to comment