Google Coral

#18
by nastasev - opened

Hi,

Would be wonderful to be able to run whisper on Google Coral. The tflite models i found are not compatible.
Unfortunately i don't have the knowledge to do it - maybe there is someone knowledgeable .

Thanx!

Hey Sanchit,

My question was if there are any whisper models adjusted so it can run on GoogleCoral/EdgeTPU? I see you pointing me towards Google Colab :) - which i know it works. Google Coral is an usb TPU accelerator made by Google. The issue with the whisper tflite quantized models i could find, was that models contained flex-ops - which are not supported by Coral.

Looking at your impressive work, I would like to ask 2 questions:
1 - is it possible to have a romanian tiny pretrained model (Mozilla has an open dataset)?
2 - is there any way of adjusting the whisper model not to use flex / dynamic tensors, so it can be compatible with Google Coral (i can help with testing or whatever needed). Running whisper on Coral would be a great feature, making whisper available for offline embedded devices (imagine offline alexa in local language).

Thanks!!
Virgil

Sign up or log in to comment