Add model params and inference engine, multiple quants for some models, f9b137e steampunque commited on Nov 7, 2024