⚡ WebGPU Benchmark Results (15.53x speedup)
#67
by
Akmittal
- opened
| Batch Size | WASM (fp16) | WebGPU (fp16) |
| 1 | 964.00 | 135.00 |
| 2 | 4445.00 | 307.00 |
| 4 | 3899.00 | 401.00 |
| 8 | 8011.00 | 722.00 |
| 16 | 17156.00 | 1199.00 |
| 32 | 34390.00 | 2214.00 |
- Model: Xenova/all-MiniLM-L6-v2
- Tests run: WASM (fp16), WebGPU (fp16)
- Sequence length: 512
- Browser: Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Mobile Safari/537.36
- GPU: vendor=arm, architecture=valhall, device=, description=