Hugging Face's logo

nrshoudi
/
speech_ocean_hubert_mdd

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
hubert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
nrshoudi commited on
Commit
1056d70
•
1 Parent(s): 8bcc5ab

End of training

Browse files
Files changed (5) hide show
  1. README.md +24 -24
  2. config.json +2 -2
  3. model.safetensors +2 -2
  4. runs/Apr29_06-56-59_ffc2dc4da7bf/events.out.tfevents.1714373854.ffc2dc4da7bf.2646.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: facebook/hubert-large-ll60k
6
  metrics:
7
  - wer
8
  model-index:
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [facebook/hubert-large-ll60k](https://huggingface.co/facebook/hubert-large-ll60k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.2060
21
- - Wer: 0.0531
22
- - Cer: 0.0507
23
 
24
  ## Model description
25
 
@@ -54,26 +54,26 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
  |:-------------:|:-------:|:----:|:---------------:|:------:|:------:|
57
- | 42.5933 | 0.9873 | 39 | 36.3096 | 0.9995 | 0.9985 |
58
- | 15.8463 | 2.0 | 79 | 7.9376 | 1.0 | 1.0 |
59
- | 6.5393 | 2.9873 | 118 | 4.5528 | 1.0 | 1.0 |
60
- | 3.9947 | 4.0 | 158 | 3.8592 | 1.0 | 1.0 |
61
- | 3.8025 | 4.9873 | 197 | 3.8002 | 1.0 | 1.0 |
62
- | 3.7706 | 6.0 | 237 | 3.7435 | 1.0 | 1.0 |
63
- | 3.7676 | 6.9873 | 276 | 3.7276 | 1.0 | 1.0 |
64
- | 3.7353 | 8.0 | 316 | 3.7150 | 1.0 | 1.0 |
65
- | 3.7126 | 8.9873 | 355 | 3.6717 | 1.0 | 1.0 |
66
- | 3.5628 | 10.0 | 395 | 3.3098 | 1.0 | 1.0 |
67
- | 2.837 | 10.9873 | 434 | 2.3304 | 0.8277 | 0.8915 |
68
- | 2.1018 | 12.0 | 474 | 1.5575 | 0.5441 | 0.6213 |
69
- | 1.6164 | 12.9873 | 513 | 1.0106 | 0.2678 | 0.2596 |
70
- | 1.1823 | 14.0 | 553 | 0.6938 | 0.1788 | 0.1509 |
71
- | 0.9451 | 14.9873 | 592 | 0.4673 | 0.1154 | 0.0925 |
72
- | 0.7055 | 16.0 | 632 | 0.3455 | 0.0893 | 0.0767 |
73
- | 0.5434 | 16.9873 | 671 | 0.2803 | 0.0718 | 0.0637 |
74
- | 0.4867 | 18.0 | 711 | 0.2362 | 0.0608 | 0.0566 |
75
- | 0.4172 | 18.9873 | 750 | 0.2125 | 0.0551 | 0.0522 |
76
- | 0.4406 | 19.7468 | 780 | 0.2060 | 0.0531 | 0.0507 |
77
 
78
 
79
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: facebook/hubert-large-ll60k
4
  tags:
5
  - generated_from_trainer
 
6
  metrics:
7
  - wer
8
  model-index:
 
17
 
18
  This model is a fine-tuned version of [facebook/hubert-large-ll60k](https://huggingface.co/facebook/hubert-large-ll60k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.2027
21
+ - Wer: 0.0517
22
+ - Cer: 0.0499
23
 
24
  ## Model description
25
 
 
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
  |:-------------:|:-------:|:----:|:---------------:|:------:|:------:|
57
+ | 42.7069 | 0.9873 | 39 | 36.7247 | 0.9992 | 0.9977 |
58
+ | 16.2787 | 2.0 | 79 | 7.8315 | 1.0 | 1.0 |
59
+ | 6.7896 | 2.9873 | 118 | 4.5645 | 1.0 | 1.0 |
60
+ | 4.0104 | 4.0 | 158 | 3.8654 | 1.0 | 1.0 |
61
+ | 3.8037 | 4.9873 | 197 | 3.8060 | 1.0 | 1.0 |
62
+ | 3.7898 | 6.0 | 237 | 3.7695 | 1.0 | 1.0 |
63
+ | 3.7777 | 6.9873 | 276 | 3.7717 | 1.0 | 1.0 |
64
+ | 3.7442 | 8.0 | 316 | 3.7320 | 1.0 | 1.0 |
65
+ | 3.7286 | 8.9873 | 355 | 3.6978 | 1.0 | 1.0 |
66
+ | 3.6272 | 10.0 | 395 | 3.5089 | 1.0 | 1.0 |
67
+ | 3.0921 | 10.9873 | 434 | 2.6068 | 0.9992 | 0.9997 |
68
+ | 2.2556 | 12.0 | 474 | 1.6832 | 0.5880 | 0.6815 |
69
+ | 1.7791 | 12.9873 | 513 | 1.2117 | 0.3861 | 0.4433 |
70
+ | 1.2731 | 14.0 | 553 | 0.7338 | 0.1793 | 0.1505 |
71
+ | 0.9596 | 14.9873 | 592 | 0.4892 | 0.1220 | 0.1005 |
72
+ | 0.7152 | 16.0 | 632 | 0.3525 | 0.0892 | 0.0752 |
73
+ | 0.521 | 16.9873 | 671 | 0.2843 | 0.0704 | 0.0623 |
74
+ | 0.4791 | 18.0 | 711 | 0.2351 | 0.0607 | 0.0568 |
75
+ | 0.3992 | 18.9873 | 750 | 0.2120 | 0.0547 | 0.0523 |
76
+ | 0.4245 | 19.7468 | 780 | 0.2027 | 0.0517 | 0.0499 |
77
 
78
 
79
  ### Framework versions
config.json CHANGED
@@ -74,10 +74,10 @@
74
  "num_conv_pos_embeddings": 128,
75
  "num_feat_extract_layers": 7,
76
  "num_hidden_layers": 24,
77
- "pad_token_id": 117,
78
  "tokenizer_class": "Wav2Vec2CTCTokenizer",
79
  "torch_dtype": "float32",
80
  "transformers_version": "4.40.0",
81
  "use_weighted_layer_sum": false,
82
- "vocab_size": 120
83
  }
 
74
  "num_conv_pos_embeddings": 128,
75
  "num_feat_extract_layers": 7,
76
  "num_hidden_layers": 24,
77
+ "pad_token_id": 124,
78
  "tokenizer_class": "Wav2Vec2CTCTokenizer",
79
  "torch_dtype": "float32",
80
  "transformers_version": "4.40.0",
81
  "use_weighted_layer_sum": false,
82
+ "vocab_size": 127
83
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fb30c3f021d1cb6a45ee8307c35ac0e61b132ddce915d2a59b49013087a2093
3
- size 1262298648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6dbee768f67d4c2a87a70056b10ca436412aa14ffed57c55f7b6409c6e2279f
3
+ size 1262327348
runs/Apr29_06-56-59_ffc2dc4da7bf/events.out.tfevents.1714373854.ffc2dc4da7bf.2646.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:419cf20033f6172852b95025c50cc7c54440113f5fb72d829da01f5e335922b4
3
+ size 29870
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fbc67eafe12d61e2b2a4f6d97a51e302eec7818741011830e7458182dc240bc8
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37c0011893ead3cadc41c51cc8f98e9c431546eeb91e5f33043d9c2ef5593d91
3
  size 5048