Are there plans to release the lightning attention kernel?
#14
by
bongchoi
- opened
Amazing work!
Are there plans to release the lightning attention kernel?
Thank you for your feedback. We are currently planning to support our models on open-source inference frameworks. At the same time, we also welcome community developers to join us in advancing the support for our models in open-source inference engines.
That sounds great!
When is it expected to be released?