WaveGenAI/lyrics-detection

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9459
-- Accuracy: 0.0
+- Loss: 0.6254
+- Accuracy: 0.6
 
 ## Model description
 
@@ -38,10 +38,10 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 3e-05
-- train_batch_size: 32
-- eval_batch_size: 32
+- train_batch_size: 1
+- eval_batch_size: 1
 - seed: 42
-- gradient_accumulation_steps: 4
+- gradient_accumulation_steps: 128
 - total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -50,18 +50,18 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 1    | 0.6881          | 1.0      |
-| No log        | 2.0   | 2    | 0.7605          | 0.0      |
-| No log        | 3.0   | 3    | 0.8241          | 0.0      |
-| No log        | 4.0   | 4    | 0.8204          | 0.0      |
-| No log        | 5.0   | 5    | 0.8452          | 0.0      |
-| No log        | 6.0   | 6    | 0.8754          | 0.0      |
-| No log        | 7.0   | 7    | 0.8984          | 0.0      |
-| No log        | 8.0   | 8    | 0.9101          | 0.0      |
-| No log        | 9.0   | 9    | 0.8928          | 0.0      |
-| 0.1385        | 10.0  | 10   | 0.9459          | 0.0      |
+| Training Loss | Epoch  | Step | Validation Loss | Accuracy |
+|:-------------:|:------:|:----:|:---------------:|:--------:|
+| No log        | 0.9956 | 7    | 0.6137          | 0.71     |
+| 0.6734        | 1.9911 | 14   | 0.5822          | 0.71     |
+| 0.6594        | 2.9867 | 21   | 0.6136          | 0.72     |
+| 0.6594        | 3.9822 | 28   | 0.6369          | 0.72     |
+| 0.6299        | 4.9778 | 35   | 0.6399          | 0.62     |
+| 0.6204        | 5.9733 | 42   | 0.6647          | 0.56     |
+| 0.6204        | 6.9689 | 49   | 0.6278          | 0.66     |
+| 0.6156        | 7.9644 | 56   | 0.6578          | 0.67     |
+| 0.6261        | 8.96   | 63   | 0.6107          | 0.65     |
+| 0.5914        | 9.9556 | 70   | 0.6254          | 0.6      |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6cb222c36b6b14659addd2fb43956b5aff6cc0dced8eec0cfd0be9a28cbeee33
+oid sha256:7f1ddb9d6172cd809a4311ec00b672aa65d5359a104defd15e716c0ac0080349
 size 378302360

runs/Aug24_15-50-28_jourdelune/events.out.tfevents.1724507428.jourdelune.39725.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:09a7dff84369a3e93b13a2e2e0904b26a43cc3bd3dc50841719e883675d58586
-size 11019
+oid sha256:6eeb0fe2811fce7c2c2936a4ae3bda074e626e315b972c53caf803070f90d798
+size 11684