lora_fine_tuned_copa_sloberta

README.md

@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [EMBEDDIA/sloberta](https://huggingface.co/EMBEDDIA/sloberta) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6926
-- Accuracy: 0.6
-- F1: 0.6
+- Loss: 0.6931
+- Accuracy: 0.47
+- F1: 0.4533
 
 ## Model description
 
@@ -40,7 +40,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
+- learning_rate: 0.003
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
@@ -52,14 +52,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
-| 0.6917        | 1.0   | 50   | 0.6926          | 0.56     | 0.5611 |
-| 0.6913        | 2.0   | 100  | 0.6926          | 0.59     | 0.5904 |
-| 0.6924        | 3.0   | 150  | 0.6926          | 0.58     | 0.5807 |
-| 0.6926        | 4.0   | 200  | 0.6926          | 0.59     | 0.5895 |
-| 0.6935        | 5.0   | 250  | 0.6925          | 0.6      | 0.6    |
-| 0.694         | 6.0   | 300  | 0.6926          | 0.6      | 0.6    |
-| 0.695         | 7.0   | 350  | 0.6926          | 0.6      | 0.6    |
-| 0.6939        | 8.0   | 400  | 0.6926          | 0.6      | 0.6    |
+| 0.698         | 1.0   | 50   | 0.6931          | 0.47     | 0.4606 |
+| 0.6955        | 2.0   | 100  | 0.6931          | 0.5      | 0.4861 |
+| 0.7099        | 3.0   | 150  | 0.6931          | 0.49     | 0.4838 |
+| 0.6962        | 4.0   | 200  | 0.6931          | 0.58     | 0.5713 |
+| 0.702         | 5.0   | 250  | 0.6931          | 0.44     | 0.4409 |
+| 0.6869        | 6.0   | 300  | 0.6931          | 0.54     | 0.5332 |
+| 0.7083        | 7.0   | 350  | 0.6931          | 0.57     | 0.5564 |
+| 0.6959        | 8.0   | 400  | 0.6931          | 0.47     | 0.4533 |
 
 
 ### Framework versions

adapter_config.json

@@ -23,6 +23,7 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "dense",
     "query",
     "value"
   ],

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5decfcb072443369beae860fe0d7972901210f9121e09a9e3de36692c082ba0b
-size 2369468
+oid sha256:7df4b8efda2e6d804d08ed37ae6515a0402501438ba7f929ba90cc926275d7bd
+size 9556124

runs/May21_19-19-43_DESKTOP-22QTFDR/events.out.tfevents.1716311987.DESKTOP-22QTFDR.34588.4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fcdefa55c187e6a36d618697562436afd3c46f691e85a54b373c2d23d56adea9
+size 9733

runs/May21_19-19-43_DESKTOP-22QTFDR/events.out.tfevents.1716312013.DESKTOP-22QTFDR.34588.5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d4f4770946b54a4a1d1f5e0be65c8d2dfac57df69383b79ccfbc46b4d14cede
+size 457

tokenizer.json

@@ -1,7 +1,14 @@
 {
   "version": "1.0",
   "truncation": null,
-  "padding": null,
+  "padding": {
+    "strategy": "BatchLongest",
+    "direction": "Right",
+    "pad_to_multiple_of": null,
+    "pad_id": 1,
+    "pad_type_id": 0,
+    "pad_token": "<pad>"
+  },
   "added_tokens": [
     {
       "id": 0,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e7af7a64d0f03c5fd40639a3b07cbed943c826bc572a90e8a940966be2ebe837
+oid sha256:00d6197168c36ea433858285906f3b8da735ac0e82c6011c90f71344a13ee4a3
 size 5048