Hugging Face's logo

Dagobert42
/
distilbert-base-uncased-biored-augmented

Token Classification
Transformers
Safetensors
English
distilbert
low-resource NER
token_classification
biomedicine
medical NER
Generated from Trainer
Inference Endpoints
Model card Files Community
Dagobert42 commited on
Commit
414fd7d
•
1 Parent(s): b2591a9

Push ../models/distilbert-base-uncased/biored-augmentations-only/ trained on biored-original_splits.pt (100 samples)

Browse files
Files changed (3) hide show
  1. README.md +12 -12
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -28,12 +28,12 @@ should probably proofread and complete it, then remove this comment. -->
28
 
29
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the bigbio/biored dataset.
30
  It achieves the following results on the evaluation set:
31
- - Loss: 0.5141
32
- - Accuracy: 0.8189
33
- - Precision: 0.6146
34
- - Recall: 0.5864
35
- - F1: 0.5983
36
- - Weighted F1: 0.8169
37
 
38
  ## Model description
39
 
@@ -64,12 +64,12 @@ The following hyperparameters were used during training:
64
 
65
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 | Weighted F1 |
66
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|:-----------:|
67
- | No log | 1.0 | 25 | 0.5409 | 0.807 | 0.6881 | 0.5326 | 0.5615 | 0.7971 |
68
- | No log | 2.0 | 50 | 0.5368 | 0.8108 | 0.7021 | 0.5447 | 0.5781 | 0.8012 |
69
- | No log | 3.0 | 75 | 0.5383 | 0.8161 | 0.6921 | 0.5484 | 0.5835 | 0.8057 |
70
- | No log | 4.0 | 100 | 0.5349 | 0.8131 | 0.6408 | 0.5885 | 0.6008 | 0.8103 |
71
- | No log | 5.0 | 125 | 0.5436 | 0.8157 | 0.6275 | 0.606 | 0.6097 | 0.8136 |
72
- | No log | 6.0 | 150 | 0.5488 | 0.8201 | 0.6805 | 0.5826 | 0.6043 | 0.8146 |
73
 
74
 
75
  ### Framework versions
 
28
 
29
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the bigbio/biored dataset.
30
  It achieves the following results on the evaluation set:
31
+ - Loss: 0.5931
32
+ - Accuracy: 0.794
33
+ - Precision: 0.6117
34
+ - Recall: 0.4962
35
+ - F1: 0.5339
36
+ - Weighted F1: 0.7824
37
 
38
  ## Model description
39
 
 
64
 
65
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 | Weighted F1 |
66
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|:-----------:|
67
+ | No log | 1.0 | 13 | 0.6199 | 0.7791 | 0.6445 | 0.4144 | 0.4762 | 0.7573 |
68
+ | No log | 2.0 | 26 | 0.6068 | 0.7865 | 0.6465 | 0.4497 | 0.5064 | 0.7621 |
69
+ | No log | 3.0 | 39 | 0.5978 | 0.7879 | 0.6267 | 0.4835 | 0.5232 | 0.7757 |
70
+ | No log | 4.0 | 52 | 0.5912 | 0.7942 | 0.6342 | 0.5039 | 0.546 | 0.7801 |
71
+ | No log | 5.0 | 65 | 0.5973 | 0.7961 | 0.6716 | 0.4927 | 0.5403 | 0.7797 |
72
+ | No log | 6.0 | 78 | 0.5925 | 0.7938 | 0.6192 | 0.5399 | 0.5572 | 0.7913 |
73
 
74
 
75
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bce09b544ffdcc240a155300e194d686ad97e01963bcb82b801684f95356ae3
3
  size 265485396
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:665130d1d0136a0018e47b509ea43573928f62b7c0722dfe38e72e9658b9154c
3
  size 265485396
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:acd71e6c71aca511280efdb10c6d032e69a1f07c4e6881e19c04257cc92ca703
3
  size 4219
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fffd5f1a3177131596e26711a23441dc083bd2e372c5a0bf5b7879a0c98ae70
3
  size 4219