Hugging Face's logo

maulairfani
/
final

Text Classification
Transformers
TensorBoard
Safetensors
bert
Inference Endpoints
Model card Files Metrics Community
maulairfani commited on
Commit
13b1a84
•
1 Parent(s): 0efe249

End of training

Browse files
Files changed (22) hide show
  1. README.md +69 -0
  2. config.json +54 -0
  3. model.safetensors +3 -0
  4. runs/Jun19_21-22-46_ed26b57fb11b/events.out.tfevents.1718832177.ed26b57fb11b.7579.0 +3 -0
  5. runs/Jun19_21-22-46_ed26b57fb11b/events.out.tfevents.1718832299.ed26b57fb11b.7579.1 +3 -0
  6. runs/Jun19_21-25-58_ed26b57fb11b/events.out.tfevents.1718832360.ed26b57fb11b.8682.0 +3 -0
  7. runs/Jun19_21-25-58_ed26b57fb11b/events.out.tfevents.1718832483.ed26b57fb11b.8682.1 +3 -0
  8. runs/Jun19_21-29-54_ed26b57fb11b/events.out.tfevents.1718832622.ed26b57fb11b.9756.0 +3 -0
  9. runs/Jun19_21-33-15_ed26b57fb11b/events.out.tfevents.1718832800.ed26b57fb11b.9756.1 +3 -0
  10. runs/Jun19_21-33-15_ed26b57fb11b/events.out.tfevents.1718832922.ed26b57fb11b.9756.2 +3 -0
  11. runs/Jun19_21-36-19_ed26b57fb11b/events.out.tfevents.1718832984.ed26b57fb11b.11617.0 +3 -0
  12. runs/Jun19_21-36-29_ed26b57fb11b/events.out.tfevents.1718832990.ed26b57fb11b.11617.1 +3 -0
  13. runs/Jun19_21-37-23_ed26b57fb11b/events.out.tfevents.1718833045.ed26b57fb11b.12123.0 +3 -0
  14. runs/Jun19_21-37-23_ed26b57fb11b/events.out.tfevents.1718833172.ed26b57fb11b.12123.1 +3 -0
  15. runs/Jun19_21-40-51_ed26b57fb11b/events.out.tfevents.1718833254.ed26b57fb11b.13132.0 +3 -0
  16. runs/Jun19_21-40-51_ed26b57fb11b/events.out.tfevents.1718833462.ed26b57fb11b.13132.1 +3 -0
  17. runs/Jun19_21-45-49_ed26b57fb11b/events.out.tfevents.1718833635.ed26b57fb11b.14594.0 +3 -0
  18. runs/Jun19_21-45-49_ed26b57fb11b/events.out.tfevents.1718833843.ed26b57fb11b.14594.1 +3 -0
  19. runs/Jun19_21-52-14_ed26b57fb11b/events.out.tfevents.1718833936.ed26b57fb11b.16468.0 +3 -0
  20. runs/Jun19_21-54-47_ed26b57fb11b/events.out.tfevents.1718834089.ed26b57fb11b.17294.0 +3 -0
  21. runs/Jun19_21-54-47_ed26b57fb11b/events.out.tfevents.1718834499.ed26b57fb11b.17294.1 +3 -0
  22. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: Amadeus99/indonesia-election-topic-classification-undersampling-large-2
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: final
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # final
15
+
16
+ This model is a fine-tuned version of [Amadeus99/indonesia-election-topic-classification-undersampling-large-2](https://huggingface.co/Amadeus99/indonesia-election-topic-classification-undersampling-large-2) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 1.3415
19
+ - F1 macro: 0.6715
20
+ - Weighted: 0.7528
21
+ - Balanced accuracy: 0.8185
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 5e-05
41
+ - train_batch_size: 32
42
+ - eval_batch_size: 32
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: cosine
46
+ - num_epochs: 10
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | F1 macro | Weighted | Balanced accuracy |
51
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:-----------------:|
52
+ | 0.836 | 1.0 | 39 | 1.0747 | 0.5558 | 0.6819 | 0.7094 |
53
+ | 0.5943 | 2.0 | 78 | 0.8587 | 0.6173 | 0.7475 | 0.8326 |
54
+ | 0.3032 | 3.0 | 117 | 0.6988 | 0.7499 | 0.7999 | 0.8840 |
55
+ | 0.1264 | 4.0 | 156 | 0.8485 | 0.7286 | 0.7915 | 0.8797 |
56
+ | 0.0819 | 5.0 | 195 | 0.9576 | 0.7197 | 0.7812 | 0.8816 |
57
+ | 0.0084 | 6.0 | 234 | 1.0325 | 0.7060 | 0.7874 | 0.8264 |
58
+ | 0.037 | 7.0 | 273 | 1.0728 | 0.7098 | 0.7940 | 0.8261 |
59
+ | 0.0176 | 8.0 | 312 | 1.0690 | 0.7148 | 0.7961 | 0.8350 |
60
+ | 0.011 | 9.0 | 351 | 1.1196 | 0.7133 | 0.7913 | 0.8341 |
61
+ | 0.003 | 10.0 | 390 | 1.1165 | 0.7133 | 0.7913 | 0.8341 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.41.2
67
+ - Pytorch 2.3.0+cu121
68
+ - Datasets 2.20.0
69
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "Amadeus99/indonesia-election-topic-classification-undersampling-large-2",
3
+ "_num_labels": 5,
4
+ "architectures": [
5
+ "BertForSequenceClassification"
6
+ ],
7
+ "attention_probs_dropout_prob": 0.1,
8
+ "classifier_dropout": null,
9
+ "directionality": "bidi",
10
+ "hidden_act": "gelu",
11
+ "hidden_dropout_prob": 0.1,
12
+ "hidden_size": 1024,
13
+ "id2label": {
14
+ "0": "Sumber Daya Alam",
15
+ "1": "Politik",
16
+ "2": "Demografi",
17
+ "3": "Pertahanan dan Keamanan",
18
+ "4": "Ideologi",
19
+ "5": "Ekonomi",
20
+ "6": "Sosial Budaya",
21
+ "7": "Geografi"
22
+ },
23
+ "initializer_range": 0.02,
24
+ "intermediate_size": 4096,
25
+ "label2id": {
26
+ "LABEL_0": 0,
27
+ "LABEL_1": 1,
28
+ "LABEL_2": 2,
29
+ "LABEL_3": 3,
30
+ "LABEL_4": 4,
31
+ "LABEL_5": 5,
32
+ "LABEL_6": 6,
33
+ "LABEL_7": 7
34
+ },
35
+ "layer_norm_eps": 1e-12,
36
+ "max_position_embeddings": 512,
37
+ "model_type": "bert",
38
+ "num_attention_heads": 16,
39
+ "num_hidden_layers": 24,
40
+ "output_past": true,
41
+ "pad_token_id": 0,
42
+ "pooler_fc_size": 768,
43
+ "pooler_num_attention_heads": 12,
44
+ "pooler_num_fc_layers": 3,
45
+ "pooler_size_per_head": 128,
46
+ "pooler_type": "first_token_transform",
47
+ "position_embedding_type": "absolute",
48
+ "problem_type": "single_label_classification",
49
+ "torch_dtype": "float32",
50
+ "transformers_version": "4.41.2",
51
+ "type_vocab_size": 2,
52
+ "use_cache": true,
53
+ "vocab_size": 30522
54
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8819dcea665d25eca4dbf216253f122e781d9b7906873a5f9dd37f09e7b2344
3
+ size 1340647360
runs/Jun19_21-22-46_ed26b57fb11b/events.out.tfevents.1718832177.ed26b57fb11b.7579.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6961811ebfa0ef82d709b65af01c566a5e597fe090270f169c3f1f85a923a7ef
3
+ size 8184
runs/Jun19_21-22-46_ed26b57fb11b/events.out.tfevents.1718832299.ed26b57fb11b.7579.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6abb84505571459acba0812ebdd2ebc7d902c6d0503a2f484df52da804abc20d
3
+ size 516
runs/Jun19_21-25-58_ed26b57fb11b/events.out.tfevents.1718832360.ed26b57fb11b.8682.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aaf2367dd5833a1f6db8fe3123b28f454a6f93dc110487328fbd3c82193d931e
3
+ size 8184
runs/Jun19_21-25-58_ed26b57fb11b/events.out.tfevents.1718832483.ed26b57fb11b.8682.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbd34c9796a814fc9e40c24e662c955ec40252f15b76481571659c43b844b774
3
+ size 516
runs/Jun19_21-29-54_ed26b57fb11b/events.out.tfevents.1718832622.ed26b57fb11b.9756.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7596aecdc893d3c100bd9281e1030cb85a66a2517e29f23a70296591ce825b53
3
+ size 6047
runs/Jun19_21-33-15_ed26b57fb11b/events.out.tfevents.1718832800.ed26b57fb11b.9756.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57a3c861bab969bf921f41fdef48afdf88e3922a134e07eeb6dff4c684709f47
3
+ size 8185
runs/Jun19_21-33-15_ed26b57fb11b/events.out.tfevents.1718832922.ed26b57fb11b.9756.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c500f0f27214818f3caa1bc04e914846fa2cb8d2117bdc3ca20b2d8a603aa51d
3
+ size 516
runs/Jun19_21-36-19_ed26b57fb11b/events.out.tfevents.1718832984.ed26b57fb11b.11617.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43f79e2cb052c7c3b4024cadfdd20b88f43ffe78caa5ec2d55e990cde12e9c6f
3
+ size 4184
runs/Jun19_21-36-29_ed26b57fb11b/events.out.tfevents.1718832990.ed26b57fb11b.11617.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:810267bfc5592ce8943afa9daf7f87e085239bfe60776bfa79f6d307375179ea
3
+ size 4184
runs/Jun19_21-37-23_ed26b57fb11b/events.out.tfevents.1718833045.ed26b57fb11b.12123.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fb0a7ecb791d5fb794ab1ca2be9d0e9003003a76a667cfdd854bfbe7cdac56d
3
+ size 8915
runs/Jun19_21-37-23_ed26b57fb11b/events.out.tfevents.1718833172.ed26b57fb11b.12123.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe2bcaa4098148fe2f123588d1d84d3ce00876e3040ae096d2e6d158856e0007
3
+ size 516
runs/Jun19_21-40-51_ed26b57fb11b/events.out.tfevents.1718833254.ed26b57fb11b.13132.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:489ef88e3f02e32b0595bab9ebbbaeacd8a0880dd90e1a40dc50fce86b74f89c
3
+ size 11781
runs/Jun19_21-40-51_ed26b57fb11b/events.out.tfevents.1718833462.ed26b57fb11b.13132.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6726004af37bac71ca7ac21502b75fa8e1c61a1a4e277d7c39d697efb1dd40c9
3
+ size 524
runs/Jun19_21-45-49_ed26b57fb11b/events.out.tfevents.1718833635.ed26b57fb11b.14594.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:303859352a31890265d3832626934ed7221899f3cbac762d7c4a83893980b38b
3
+ size 11972
runs/Jun19_21-45-49_ed26b57fb11b/events.out.tfevents.1718833843.ed26b57fb11b.14594.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84bbc60481e64e9c2d39ffcd870b3fed2b544411abc94064b4678bb7e12b4628
3
+ size 524
runs/Jun19_21-52-14_ed26b57fb11b/events.out.tfevents.1718833936.ed26b57fb11b.16468.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:765743d40d50815095fba96de6d4c26ac35782f9379f59d424147ed09fe4fd6a
3
+ size 7393
runs/Jun19_21-54-47_ed26b57fb11b/events.out.tfevents.1718834089.ed26b57fb11b.17294.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ee01ac61d69a191b16fd0700bd063b342b10f11919b847dafeefacd1f02527a
3
+ size 18373
runs/Jun19_21-54-47_ed26b57fb11b/events.out.tfevents.1718834499.ed26b57fb11b.17294.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:176644b7ac8b590a9ee4f08a9166586f3ace60a2a2a3f09fc64e0d707a5476da
3
+ size 524
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b28e8cfc33e4841a69ae41c73e33d6ba7f0e7eb5e316178e6e98a5841c7d7683
3
+ size 5112