qaihm-bot commited on
Commit
43f7b60
1 Parent(s): ff8f628

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -34,12 +34,15 @@ More details on model performance across various devices, can be found
34
  - Model size (WhisperDecoder): 108 MB
35
 
36
 
 
 
37
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
38
  | ---|---|---|---|---|---|---|---|
39
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 68.848 ms | 0 - 46 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite)
40
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 3.779 ms | 3 - 7 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite)
41
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 287.627 ms | 1 - 45 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.so)
42
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 3.638 ms | 9 - 45 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.so)
 
43
 
44
 
45
  ## Installation
@@ -101,22 +104,24 @@ python -m qai_hub_models.models.whisper_tiny_en.export
101
  Profile Job summary of WhisperEncoder
102
  --------------------------------------------------
103
  Device: Snapdragon X Elite CRD (11)
104
- Estimated Inference Time: 239.16 ms
105
  Estimated Peak Memory Range: 0.92-0.92 MB
106
  Compute Units: NPU (337) | Total (337)
107
 
108
  Profile Job summary of WhisperDecoder
109
  --------------------------------------------------
110
  Device: Snapdragon X Elite CRD (11)
111
- Estimated Inference Time: 3.68 ms
112
  Estimated Peak Memory Range: 20.25-20.25 MB
113
  Compute Units: NPU (447) | Total (447)
114
 
115
 
116
  ```
 
 
117
  ## How does this work?
118
 
119
- This [export script](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/Whisper-Tiny-En/export.py)
120
  leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model
121
  on-device. Lets go through each step below in detail:
122
 
@@ -194,6 +199,7 @@ AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
194
 
195
 
196
 
 
197
  ## Deploying compiled model to Android
198
 
199
 
@@ -215,7 +221,7 @@ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
215
  ## License
216
  - The license for the original implementation of Whisper-Tiny-En can be found
217
  [here](https://github.com/openai/whisper/blob/main/LICENSE).
218
- - The license for the compiled assets for on-device deployment can be found [here]({deploy_license_url})
219
 
220
  ## References
221
  * [Robust Speech Recognition via Large-Scale Weak Supervision](https://cdn.openai.com/papers/whisper.pdf)
 
34
  - Model size (WhisperDecoder): 108 MB
35
 
36
 
37
+
38
+
39
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  | ---|---|---|---|---|---|---|---|
41
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 68.47 ms | 16 - 62 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite)
42
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 3.853 ms | 3 - 6 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite)
43
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 286.944 ms | 1 - 50 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.so)
44
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 3.672 ms | 20 - 46 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.so)
45
+
46
 
47
 
48
  ## Installation
 
104
  Profile Job summary of WhisperEncoder
105
  --------------------------------------------------
106
  Device: Snapdragon X Elite CRD (11)
107
+ Estimated Inference Time: 237.87 ms
108
  Estimated Peak Memory Range: 0.92-0.92 MB
109
  Compute Units: NPU (337) | Total (337)
110
 
111
  Profile Job summary of WhisperDecoder
112
  --------------------------------------------------
113
  Device: Snapdragon X Elite CRD (11)
114
+ Estimated Inference Time: 3.77 ms
115
  Estimated Peak Memory Range: 20.25-20.25 MB
116
  Compute Units: NPU (447) | Total (447)
117
 
118
 
119
  ```
120
+
121
+
122
  ## How does this work?
123
 
124
+ This [export script](https://aihub.qualcomm.com/models/whisper_tiny_en/qai_hub_models/models/Whisper-Tiny-En/export.py)
125
  leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model
126
  on-device. Lets go through each step below in detail:
127
 
 
199
 
200
 
201
 
202
+
203
  ## Deploying compiled model to Android
204
 
205
 
 
221
  ## License
222
  - The license for the original implementation of Whisper-Tiny-En can be found
223
  [here](https://github.com/openai/whisper/blob/main/LICENSE).
224
+ - The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
225
 
226
  ## References
227
  * [Robust Speech Recognition via Large-Scale Weak Supervision](https://cdn.openai.com/papers/whisper.pdf)