How much does it take for Falcon 11b to run inference smoothly?

#11
by PacoBOe - opened

Hello there,
I was wondering how much resources are needed to run inference smoothly with this model. Would it be possible to run this on a decent personal computer of, for instance, 32gb of memory? (and matching cpu and gpu power)
Thanks so much for the help!

Sign up or log in to comment