|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- KBLab/rixvox |
|
language: |
|
- sv |
|
--- |
|
# Whisper Large RixVox Swedish |
|
|
|
This is a [Whisper large](https://huggingface.co./openai/whisper-large-v2) finetuned for Swedish using |
|
the [RixVox](https://huggingface.co./datasets/KBLab/rixvox) dataset. |
|
|
|
## Evaluation |
|
|
|
### [Common Voice 11](#): |
|
* WER: XYZ |
|
* WER (normalized): XYZ |
|
|
|
## Training |
|
|
|
Training was done using Huggingface and Deepspeed with ZeRO stage 2. |
|
|
|
* learning rate: 1e-5 |
|
* optimizer: CPUAdamW (Deepspeed) |
|
* lr scheduler: linear |
|
* warmup steps: 500 |
|
* per device batch size: 20 |
|
* GPUs: 8 x NVIDIA A100 40GB |
|
* total batch size: 160 |
|
* steps: 12000 |
|
* lowercase: no |
|
* fp16 |
|
* entire encoder was frozen |
