Overview
WhisperVQ
WhisperVQ is a quantizer model and a key component of WhisperSpeech. It compresses speech into discrete tokens, enabling seamless compatibility with large language models (LLMs) for real-time speech understanding and various downstream tasks.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | gguf | cortex run whispervq |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexso/whispervq
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run whispervq