Support for Flash Attention?

#15
by arnaudstiegler - opened

Any particular reason why paligemma doesn't support flash attention? Looks like Siglip doesn't have flash-attention support, but Gemma has it so it could be enabled on the LM side

Google org

Hi @arnaudstiegler , Please have a look at the similar issue, might be helpful in this. Thank you.

Sign up or log in to comment