lora_fine_tuned_copa_sloberta

README.md

@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [EMBEDDIA/sloberta](https://huggingface.co/EMBEDDIA/sloberta) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6931
-- Accuracy: 0.51
-- F1: 0.5110
+- Loss: 0.6926
+- Accuracy: 0.6
+- F1: 0.6
 
 ## Model description
 
@@ -40,7 +40,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.003
+- learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
@@ -52,14 +52,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
-| 0.6977        | 1.0   | 50   | 0.6931          | 0.53     | 0.5242 |
-| 0.6925        | 2.0   | 100  | 0.6931          | 0.45     | 0.4514 |
-| 0.695         | 3.0   | 150  | 0.6931          | 0.61     | 0.6085 |
-| 0.6982        | 4.0   | 200  | 0.6931          | 0.44     | 0.4200 |
-| 0.699         | 5.0   | 250  | 0.6931          | 0.63     | 0.6285 |
-| 0.6962        | 6.0   | 300  | 0.6931          | 0.51     | 0.5062 |
-| 0.6918        | 7.0   | 350  | 0.6931          | 0.39     | 0.3893 |
-| 0.6983        | 8.0   | 400  | 0.6931          | 0.51     | 0.5110 |
+| 0.6917        | 1.0   | 50   | 0.6926          | 0.56     | 0.5611 |
+| 0.6913        | 2.0   | 100  | 0.6926          | 0.59     | 0.5904 |
+| 0.6924        | 3.0   | 150  | 0.6926          | 0.58     | 0.5807 |
+| 0.6926        | 4.0   | 200  | 0.6926          | 0.59     | 0.5895 |
+| 0.6935        | 5.0   | 250  | 0.6925          | 0.6      | 0.6    |
+| 0.694         | 6.0   | 300  | 0.6926          | 0.6      | 0.6    |
+| 0.695         | 7.0   | 350  | 0.6926          | 0.6      | 0.6    |
+| 0.6939        | 8.0   | 400  | 0.6926          | 0.6      | 0.6    |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:034e1b9e0934b1d862e2f1e233c796a02ac4b8819d6c5c95599dacae17ed43ac
+oid sha256:5decfcb072443369beae860fe0d7972901210f9121e09a9e3de36692c082ba0b
 size 2369468

runs/May21_18-30-10_DESKTOP-22QTFDR/events.out.tfevents.1716309012.DESKTOP-22QTFDR.34588.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e154fa52f031082c46e8016aa34fa2094063d061c59dfa70bfd0107d1110bf9b
+size 9733

runs/May21_18-30-10_DESKTOP-22QTFDR/events.out.tfevents.1716309033.DESKTOP-22QTFDR.34588.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ba679044c879d33da1e0aeae8550b181461d9638a7cc9514e665623ed5e9d3a
+size 457

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4965e0b8b642cd7afe435803d6f326ac9287f4565085442d4581c8781bfe8170
+oid sha256:e7af7a64d0f03c5fd40639a3b07cbed943c826bc572a90e8a940966be2ebe837
 size 5048