End of training

README.md

@@ -18,8 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.4411
-- Accuracy: 0.8245
+- Loss: 0.4837
+- Accuracy: 0.8181
+- F1 Macro: 0.7738
 
 ## Model description
 
@@ -38,25 +39,27 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
-- train_batch_size: 64
-- eval_batch_size: 64
+- learning_rate: 2.3824605150324688e-05
+- train_batch_size: 32
+- eval_batch_size: 32
 - seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 2
+- num_epochs: 10
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|
-| 0.766         | 1.0   | 659  | 0.4984          | 0.7988   |
-| 0.4755        | 2.0   | 1318 | 0.4417          | 0.8231   |
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
+| No log        | 1.0   | 461  | 0.5790          | 0.7710   | 0.7130   |
+| 0.7525        | 2.0   | 922  | 0.4944          | 0.8101   | 0.7655   |
+| 0.4358        | 3.0   | 1383 | 0.5003          | 0.8166   | 0.7867   |
+| 0.3137        | 4.0   | 1844 | 0.5757          | 0.8220   | 0.7946   |
 
 
 ### Framework versions
 
-- Transformers 4.45.1
+- Transformers 4.46.3
 - Pytorch 2.4.0
-- Datasets 3.0.1
-- Tokenizers 0.20.0
+- Datasets 3.1.0
+- Tokenizers 0.20.3

config.json

@@ -38,6 +38,6 @@
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
   "torch_dtype": "float32",
-  "transformers_version": "4.45.1",
+  "transformers_version": "4.46.3",
   "vocab_size": 30522
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1f3729484c651da1a7bf2a4aaeb8c33c6a1e5bf5987de5991ada7c93d0cc8e31
+oid sha256:ccda302f41a2f93c701a238ac78970c5ec9333b6182824a9b89efdbc2c6b60f9
 size 267847948

runs/Dec05_15-51-03_a4efccb8f56a/events.out.tfevents.1733413864.a4efccb8f56a.23.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd7589b0b03e356c0b6ee2332e4f3c32b26fa80e9ef25b956d35a3e1fdaf89a6
+size 5332

runs/Dec05_15-53-29_a4efccb8f56a/events.out.tfevents.1733414009.a4efccb8f56a.23.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:053dfd73d1d190d8c7446747aed20d05f13ad2e3a22b964ab441b17328a72813
+size 7820

runs/Dec05_15-53-29_a4efccb8f56a/events.out.tfevents.1733415564.a4efccb8f56a.23.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f678fd3b88b935ea6e707c1453e60b26831b0f028d805bda9884e26224c1a3d
+size 463

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fa127c51ac656d521628f56052615fbcc0704559777c6480b59157742ab56162
-size 5240
+oid sha256:878efa4fcd24bfe0291a583fcf81ef0d9e79ebdd8e35f30ab5cee78d39de42d3
+size 5304