updated template
Browse files
README.md
CHANGED
@@ -28,35 +28,32 @@ widget:
|
|
28 |
---
|
29 |
|
30 |
|
31 |
-
# NB-Whisper Base
|
32 |
-
|
33 |
-
**IMPORTANT:** These models are currently Release Candidates. We are in the final stages of testing. If everything proceeds smoothly, we plan to officially release the models later this month.
|
34 |
|
35 |
Introducing the **_Norwegian NB-Whisper Base model_**, proudly developed by the National Library of Norway. NB-Whisper is a cutting-edge series of models designed for automatic speech recognition (ASR) and speech translation. These models are based on the work of [OpenAI's Whisper](https://arxiv.org/abs/2212.04356). Each model in the series has been trained for 250,000 steps, utilizing a diverse dataset of 8 million samples. These samples consist of aligned audio clips, each 30 seconds long, culminating in a staggering 66,000 hours of speech. For an in-depth understanding of our training methodology and dataset composition, keep an eye out for our upcoming article.
|
36 |
|
37 |
| Model Size | Parameters | Model |
|
38 |
|------------|------------|------------|
|
39 |
-
| Tiny | 39M | [NB-Whisper Tiny](https://huggingface.co/
|
40 |
-
| Base | 74M | [NB-Whisper Base](https://huggingface.co/
|
41 |
-
| Small | 244M | [NB-Whisper Small](https://huggingface.co/
|
42 |
-
| Medium | 769M | [NB-Whisper Medium](https://huggingface.co/
|
43 |
-
| Large | 1550M | [NB-Whisper Large](https://huggingface.co/
|
44 |
|
45 |
|
46 |
|
47 |
-
###
|
48 |
While the main models are suitable for most transcription task, we demonstrate how easy it is to change the output of the main model. The following models are trained 250 additional steps from the main models above, and might be suitable for more targetted use cases:
|
49 |
- **Verbatim version**: This lower-cased variant is more literal and suitable for tasks requiring detailed transcription, such as linguistic analysis.
|
50 |
-
- **Semantic version**: This variant focuses less on verbatim accuracy but captures the essence of content, ideal for meeting minutes and subtitling.
|
51 |
|
52 |
|
53 |
-
| Model Size | Parameters |
|
54 |
-
|
55 |
-
| Tiny | 39M | [Tiny -
|
56 |
-
| Base | 74M | [Base -
|
57 |
-
| Small | 244M | [Small -
|
58 |
-
| Medium | 769M | [Medium -
|
59 |
-
| Large | 1550M | [Large -
|
60 |
|
61 |
|
62 |
### Model Description
|
@@ -75,7 +72,7 @@ While the main models are suitable for most transcription task, we demonstrate h
|
|
75 |
## How to Use the Models
|
76 |
|
77 |
### Online Demos
|
78 |
-
You can try the models directly through the HuggingFace Inference API, accessible on the right side of this page. Be aware that initially, the model needs to load and will run on limited CPU capacity, which might be slow. To enhance your experience, we are temporarily hosting some models on TPUs for a few days, significantly boosting their performance. Explore these under the **Spaces** section on the [Main Page](https://huggingface.co/
|
79 |
|
80 |
### Local Setup with HuggingFace
|
81 |
Alternatively, you can run the models locally. The Tiny, Base, and Small models are optimized for CPU execution. For the Medium and Large models, we recommend a system equipped with a GPU to ensure efficient processing. Setting up and using these models with HuggingFace's Transformers is straightforward, provided you have [Python](https://www.python.org/downloads/) installed on your machine. For practical demonstrations, refer to examples using this [sample mp3 file](https://github.com/NbAiLab/nb-whisper/raw/main/audio/king.mp3).
|
@@ -223,8 +220,8 @@ $ wget -N https://github.com/NbAiLab/nb-whisper/raw/main/audio/king.mp3
|
|
223 |
$ ffmpeg -i king.mp3 -ar 16000 -ac 1 -c:a pcm_s16le king.wav
|
224 |
|
225 |
# Lets download the two ggml-files from this site
|
226 |
-
wget -N https://huggingface.co/
|
227 |
-
wget -N https://huggingface.co/
|
228 |
|
229 |
# And run it with the f16 default model
|
230 |
$ ./main -l no -m models/nb-base-ggml-model.bin king.wav
|
|
|
28 |
---
|
29 |
|
30 |
|
31 |
+
# NB-Whisper Base
|
|
|
|
|
32 |
|
33 |
Introducing the **_Norwegian NB-Whisper Base model_**, proudly developed by the National Library of Norway. NB-Whisper is a cutting-edge series of models designed for automatic speech recognition (ASR) and speech translation. These models are based on the work of [OpenAI's Whisper](https://arxiv.org/abs/2212.04356). Each model in the series has been trained for 250,000 steps, utilizing a diverse dataset of 8 million samples. These samples consist of aligned audio clips, each 30 seconds long, culminating in a staggering 66,000 hours of speech. For an in-depth understanding of our training methodology and dataset composition, keep an eye out for our upcoming article.
|
34 |
|
35 |
| Model Size | Parameters | Model |
|
36 |
|------------|------------|------------|
|
37 |
+
| Tiny | 39M | [NB-Whisper Tiny](https://huggingface.co/NbAiLab/nb-whisper-tiny) |
|
38 |
+
| Base | 74M | [NB-Whisper Base](https://huggingface.co/NbAiLab/nb-whisper-base) |
|
39 |
+
| Small | 244M | [NB-Whisper Small](https://huggingface.co/NbAiLab/nb-whisper-small) |
|
40 |
+
| Medium | 769M | [NB-Whisper Medium](https://huggingface.co/NbAiLab/nb-whisper-medium) |
|
41 |
+
| Large | 1550M | [NB-Whisper Large](https://huggingface.co/NbAiLab/nb-whisper-large) |
|
42 |
|
43 |
|
44 |
|
45 |
+
### Verbatim Model
|
46 |
While the main models are suitable for most transcription task, we demonstrate how easy it is to change the output of the main model. The following models are trained 250 additional steps from the main models above, and might be suitable for more targetted use cases:
|
47 |
- **Verbatim version**: This lower-cased variant is more literal and suitable for tasks requiring detailed transcription, such as linguistic analysis.
|
|
|
48 |
|
49 |
|
50 |
+
| Model Size | Parameters | Semantic version |
|
51 |
+
|------------|------------|------------------|
|
52 |
+
| Tiny | 39M | [Tiny - semantic](https://huggingface.co/NbAiLab/nb-whisper-tiny-semantic) |
|
53 |
+
| Base | 74M | [Base - semantic](https://huggingface.co/NbAiLab/nb-whisper-base-semantic) |
|
54 |
+
| Small | 244M | [Small - semantic](https://huggingface.co/NbAiLab/nb-whisper-small-semantic) |
|
55 |
+
| Medium | 769M | [Medium - semantic](https://huggingface.co/NbAiLab/nb-whisper-medium-semantic) |
|
56 |
+
| Large | 1550M | [Large - semantic](https://huggingface.co/NbAiLab/nb-whisper-large-semantic) |
|
57 |
|
58 |
|
59 |
### Model Description
|
|
|
72 |
## How to Use the Models
|
73 |
|
74 |
### Online Demos
|
75 |
+
You can try the models directly through the HuggingFace Inference API, accessible on the right side of this page. Be aware that initially, the model needs to load and will run on limited CPU capacity, which might be slow. To enhance your experience, we are temporarily hosting some models on TPUs for a few days, significantly boosting their performance. Explore these under the **Spaces** section on the [Main Page](https://huggingface.co/NbAiLab/).
|
76 |
|
77 |
### Local Setup with HuggingFace
|
78 |
Alternatively, you can run the models locally. The Tiny, Base, and Small models are optimized for CPU execution. For the Medium and Large models, we recommend a system equipped with a GPU to ensure efficient processing. Setting up and using these models with HuggingFace's Transformers is straightforward, provided you have [Python](https://www.python.org/downloads/) installed on your machine. For practical demonstrations, refer to examples using this [sample mp3 file](https://github.com/NbAiLab/nb-whisper/raw/main/audio/king.mp3).
|
|
|
220 |
$ ffmpeg -i king.mp3 -ar 16000 -ac 1 -c:a pcm_s16le king.wav
|
221 |
|
222 |
# Lets download the two ggml-files from this site
|
223 |
+
wget -N https://huggingface.co/NbAiLab/nb-whisper-base/resolve/main/ggml-model.bin -O models/nb-base-ggml-model.bin
|
224 |
+
wget -N https://huggingface.co/NbAiLab/nb-whisper-base/resolve/main/ggml-model-q5_0.bin -O models/nb-base-ggml-model-q5_0.bin
|
225 |
|
226 |
# And run it with the f16 default model
|
227 |
$ ./main -l no -m models/nb-base-ggml-model.bin king.wav
|