Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -38,62 +38,61 @@ More details on model performance across various devices, can be found
|
|
38 |
|
39 |
| Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
40 |
|---|---|---|---|---|---|---|---|---|
|
41 |
-
| WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE |
|
42 |
-
| WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 2.
|
43 |
-
| WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 3.
|
44 |
-
| WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 1.
|
45 |
-
| WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 2.
|
46 |
-
| WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 1.
|
47 |
-
| WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE |
|
48 |
-
| WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 2.
|
49 |
-
| WhisperDecoder | SA7255P ADP | SA7255P | TFLITE | 18.
|
50 |
-
| WhisperDecoder | SA7255P ADP | SA7255P | QNN | 15.
|
51 |
-
| WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE |
|
52 |
-
| WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 2.
|
53 |
-
| WhisperDecoder | SA8295P ADP | SA8295P | TFLITE | 5.
|
54 |
-
| WhisperDecoder | SA8295P ADP | SA8295P | QNN | 3.
|
55 |
-
| WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE |
|
56 |
-
| WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 2.
|
57 |
-
| WhisperDecoder | SA8775P ADP | SA8775P | TFLITE | 5.
|
58 |
-
| WhisperDecoder | SA8775P ADP | SA8775P | QNN | 3.
|
59 |
-
| WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 4.
|
60 |
-
| WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 2.
|
61 |
-
| WhisperDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 2.
|
62 |
-
| WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE |
|
63 |
-
| WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN |
|
64 |
-
| WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 82.
|
65 |
-
| WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 108.
|
66 |
-
| WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE |
|
67 |
-
| WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN |
|
68 |
-
| WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE |
|
69 |
-
| WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 105.
|
70 |
-
| WhisperEncoder | SA7255P ADP | SA7255P | TFLITE |
|
71 |
-
| WhisperEncoder | SA7255P ADP | SA7255P | QNN |
|
72 |
-
| WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE |
|
73 |
-
| WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN |
|
74 |
-
| WhisperEncoder | SA8295P ADP | SA8295P | TFLITE |
|
75 |
-
| WhisperEncoder | SA8295P ADP | SA8295P | QNN | 127.
|
76 |
-
| WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 100.
|
77 |
-
| WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 106.
|
78 |
-
| WhisperEncoder | SA8775P ADP | SA8775P | TFLITE |
|
79 |
-
| WhisperEncoder | SA8775P ADP | SA8775P | QNN | 119.
|
80 |
-
| WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE |
|
81 |
-
| WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN |
|
82 |
-
| WhisperEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 97.
|
83 |
|
84 |
|
85 |
|
86 |
|
87 |
## Installation
|
88 |
|
89 |
-
This model can be installed as a Python package via pip.
|
90 |
|
|
|
91 |
```bash
|
92 |
-
pip install "qai-hub-models[
|
93 |
```
|
94 |
|
95 |
|
96 |
-
|
97 |
## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
|
98 |
|
99 |
Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
|
@@ -144,8 +143,8 @@ Profiling Results
|
|
144 |
WhisperDecoder
|
145 |
Device : Samsung Galaxy S23 (13)
|
146 |
Runtime : TFLITE
|
147 |
-
Estimated inference time (ms) :
|
148 |
-
Estimated peak memory usage (MB): [
|
149 |
Total # Ops : 557
|
150 |
Compute Unit(s) : NPU (557 ops)
|
151 |
|
@@ -153,7 +152,7 @@ Compute Unit(s) : NPU (557 ops)
|
|
153 |
WhisperEncoder
|
154 |
Device : Samsung Galaxy S23 (13)
|
155 |
Runtime : TFLITE
|
156 |
-
Estimated inference time (ms) :
|
157 |
Estimated peak memory usage (MB): [20, 69]
|
158 |
Total # Ops : 271
|
159 |
Compute Unit(s) : GPU (260 ops) CPU (11 ops)
|
@@ -287,7 +286,8 @@ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
|
|
287 |
|
288 |
|
289 |
## License
|
290 |
-
* The license for the original implementation of Whisper-Tiny-En can be found
|
|
|
291 |
* The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
|
292 |
|
293 |
|
|
|
38 |
|
39 |
| Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
40 |
|---|---|---|---|---|---|---|---|---|
|
41 |
+
| WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 4.081 ms | 3 - 48 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
42 |
+
| WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 2.355 ms | 0 - 81 MB | FP16 | NPU | [Whisper-Tiny-En.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.so) |
|
43 |
+
| WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 3.143 ms | 2 - 65 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
44 |
+
| WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 1.719 ms | 0 - 43 MB | FP16 | NPU | [Whisper-Tiny-En.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.so) |
|
45 |
+
| WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 2.844 ms | 0 - 59 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
46 |
+
| WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 1.569 ms | 4 - 49 MB | FP16 | NPU | Use Export Script |
|
47 |
+
| WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 4.056 ms | 3 - 41 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
48 |
+
| WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 2.388 ms | 10 - 13 MB | FP16 | NPU | Use Export Script |
|
49 |
+
| WhisperDecoder | SA7255P ADP | SA7255P | TFLITE | 18.264 ms | 3 - 57 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
50 |
+
| WhisperDecoder | SA7255P ADP | SA7255P | QNN | 15.495 ms | 9 - 18 MB | FP16 | NPU | Use Export Script |
|
51 |
+
| WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 3.901 ms | 4 - 42 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
52 |
+
| WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 2.323 ms | 10 - 13 MB | FP16 | NPU | Use Export Script |
|
53 |
+
| WhisperDecoder | SA8295P ADP | SA8295P | TFLITE | 5.204 ms | 2 - 56 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
54 |
+
| WhisperDecoder | SA8295P ADP | SA8295P | QNN | 3.59 ms | 1 - 16 MB | FP16 | NPU | Use Export Script |
|
55 |
+
| WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 3.987 ms | 3 - 40 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
56 |
+
| WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 2.357 ms | 10 - 13 MB | FP16 | NPU | Use Export Script |
|
57 |
+
| WhisperDecoder | SA8775P ADP | SA8775P | TFLITE | 5.314 ms | 3 - 57 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
58 |
+
| WhisperDecoder | SA8775P ADP | SA8775P | QNN | 3.464 ms | 9 - 19 MB | FP16 | NPU | Use Export Script |
|
59 |
+
| WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 4.6 ms | 3 - 57 MB | FP16 | NPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperDecoder.tflite) |
|
60 |
+
| WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 2.801 ms | 4 - 51 MB | FP16 | NPU | Use Export Script |
|
61 |
+
| WhisperDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 2.278 ms | 10 - 10 MB | FP16 | NPU | Use Export Script |
|
62 |
+
| WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 107.957 ms | 20 - 69 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
63 |
+
| WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 136.124 ms | 0 - 55 MB | FP16 | NPU | [Whisper-Tiny-En.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.so) |
|
64 |
+
| WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 82.061 ms | 20 - 61 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
65 |
+
| WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 108.183 ms | 0 - 190 MB | FP16 | NPU | [Whisper-Tiny-En.so](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.so) |
|
66 |
+
| WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 78.471 ms | 18 - 44 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
67 |
+
| WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 100.952 ms | 0 - 195 MB | FP16 | NPU | Use Export Script |
|
68 |
+
| WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 103.367 ms | 20 - 69 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
69 |
+
| WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 105.81 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
|
70 |
+
| WhisperEncoder | SA7255P ADP | SA7255P | TFLITE | 533.865 ms | 20 - 42 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
71 |
+
| WhisperEncoder | SA7255P ADP | SA7255P | QNN | 465.758 ms | 1 - 10 MB | FP16 | NPU | Use Export Script |
|
72 |
+
| WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 117.397 ms | 20 - 68 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
73 |
+
| WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 106.906 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
|
74 |
+
| WhisperEncoder | SA8295P ADP | SA8295P | TFLITE | 106.724 ms | 21 - 50 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
75 |
+
| WhisperEncoder | SA8295P ADP | SA8295P | QNN | 127.702 ms | 1 - 15 MB | FP16 | NPU | Use Export Script |
|
76 |
+
| WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 100.555 ms | 20 - 68 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
77 |
+
| WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 106.923 ms | 0 - 3 MB | FP16 | NPU | Use Export Script |
|
78 |
+
| WhisperEncoder | SA8775P ADP | SA8775P | TFLITE | 178.166 ms | 20 - 43 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
79 |
+
| WhisperEncoder | SA8775P ADP | SA8775P | QNN | 119.208 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
|
80 |
+
| WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 132.304 ms | 20 - 63 MB | FP16 | GPU | [Whisper-Tiny-En.tflite](https://huggingface.co/qualcomm/Whisper-Tiny-En/blob/main/WhisperEncoder.tflite) |
|
81 |
+
| WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 175.796 ms | 0 - 195 MB | FP16 | NPU | Use Export Script |
|
82 |
+
| WhisperEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 97.393 ms | 0 - 0 MB | FP16 | NPU | Use Export Script |
|
83 |
|
84 |
|
85 |
|
86 |
|
87 |
## Installation
|
88 |
|
|
|
89 |
|
90 |
+
Install the package via pip:
|
91 |
```bash
|
92 |
+
pip install "qai-hub-models[whisper-tiny-en]"
|
93 |
```
|
94 |
|
95 |
|
|
|
96 |
## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
|
97 |
|
98 |
Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
|
|
|
143 |
WhisperDecoder
|
144 |
Device : Samsung Galaxy S23 (13)
|
145 |
Runtime : TFLITE
|
146 |
+
Estimated inference time (ms) : 4.1
|
147 |
+
Estimated peak memory usage (MB): [3, 48]
|
148 |
Total # Ops : 557
|
149 |
Compute Unit(s) : NPU (557 ops)
|
150 |
|
|
|
152 |
WhisperEncoder
|
153 |
Device : Samsung Galaxy S23 (13)
|
154 |
Runtime : TFLITE
|
155 |
+
Estimated inference time (ms) : 108.0
|
156 |
Estimated peak memory usage (MB): [20, 69]
|
157 |
Total # Ops : 271
|
158 |
Compute Unit(s) : GPU (260 ops) CPU (11 ops)
|
|
|
286 |
|
287 |
|
288 |
## License
|
289 |
+
* The license for the original implementation of Whisper-Tiny-En can be found
|
290 |
+
[here](https://github.com/openai/whisper/blob/main/LICENSE).
|
291 |
* The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
|
292 |
|
293 |
|