Hugging Face's logo

autoevaluate
/
multi-class-classification-not-evaluated

Text Classification
Transformers
PyTorch
TensorBoard
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
2
multi-class-classification-not-evaluated / README.md
lewtun's picture
lewtun HF staff
Add evaluation results on the default config and test split of emotion
bdef447
preview code
|
raw
history blame
5.88 kB
metadata
license: apache-2.0
tags:
  - generated_from_trainer
datasets:
  - emotion
metrics:
  - accuracy
duplicated_from: autoevaluate/multi-class-classification
model-index:
  - name: autoevaluate/multi-class-classification-not-evaluated
    results:
      - task:
          type: text-classification
          name: Text Classification
        dataset:
          name: emotion
          type: emotion
          config: default
          split: test
        metrics:
          - type: accuracy
            value: 0.9185
            name: Accuracy
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWNlMDZhOGI5MDA4YThiNGZkNjUyYThjMDk2YTNkZWZiMGE2ZTE0ZGQ4MzI3YmZjMWFlMDYyZTU5OWI3NjBjMSIsInZlcnNpb24iOjF9.CPH2GRSfdEWKe3NeWvDImlVIBvolD8MfRVyVeHzzMhGch_PqGCEkwm3evoOhLRMdFU0HZji9UXTDiX-VXvYUCQ
          - type: f1
            value: 0.8692821860210945
            name: F1 Macro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmYzZTI3MjBhMmQzYWU2OWYzZTUyYmYyOWVlMGFiZDhlZDU4MWU3YjJjZGEyZmMyN2RkNWI4OTkwZTdhZjY4NCIsInZlcnNpb24iOjF9.Xm7fZhE_zTU1wB475IlmP6KpAW9bmLNxxgTuRdzhe8o7NCWRWywDUZfbkhLnbHJxW4k8OjPDzqJJf6g3Urg5DQ
          - type: f1
            value: 0.9185
            name: F1 Micro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODNhNDUwYmYzNDkzNTE2ZjU5YWI3ZDBiM2E4NmM3YTM4OWY2YjJlNWMxNmM2YTk0NmJlNTAzM2IxYmEyODNlNSIsInZlcnNpb24iOjF9.gokzgE9dEIobZWVcvMK3uhW3fbxqy8rc7TLaRhiCUezqbVzW-2LLkiBHzmJePwEj11cDTCJiOaSoK5kC2nlJAw
          - type: f1
            value: 0.9181177508591364
            name: F1 Weighted
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGU5MThhMWRlZmRhZjUwZjczYzg0M2E4ZjBjZTZmNWY0NDU0NDg5Mzg1NWZmMWYyMDAzMmQ5OTdhYjE5MTgyNyIsInZlcnNpb24iOjF9.1xABG8F5u5pB311Z5SSN6fS_0_xKulMcFNEeVH2yAJ1e7MwX6Llz71q5lzlQcoO2ihNuBataAKhj4xNGZDLSAA
          - type: precision
            value: 0.8738350796775306
            name: Precision Macro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWY3ZTQxYzRlMTZiOGVjMDllYmQwOTJlZWNjYTdhN2U5ZTcwNmI3MTVjMjcwNGJkYTVkOTNhZmQ1MDE3ZGEzYyIsInZlcnNpb24iOjF9.J6yiomm6SSj1T4lT0cwCvKUC0lGzCACtKl4FvwPQ7qgC6Vas-oZsnkw2N7t2YZztSRLYfvr926PpC7P88sCABA
          - type: precision
            value: 0.9185
            name: Precision Micro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjY4YTU5NjE4MjNlNmEzOWI4MzdhYTFlMDY4NjY0ODI1Y2UyZjM5ODRmYzE3ZjJiMzdjZWE3YjJkZWUxNTZiZCIsInZlcnNpb24iOjF9.6Is3-2UY4H6VNNl9y7D_mZGvwX1KfZLfn9zQ2-yksCmSyYxzqkX0KJ2rNilG6e3iq9f8rfwp_LU68cW8cYkWBg
          - type: precision
            value: 0.9179425177997311
            name: Precision Weighted
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODMzZThhOTY2ZWRjNmZjMTg1MGIzZjg0ZWZjZDIyZDc1M2RhZTFjZTE5ZDdmNjg1NTQ5M2EzMzBmYTBmZTc0YyIsInZlcnNpb24iOjF9.7FZIy3iqHQEjfXowTLo70uyDvoX2LTJxujF4yKfcPEJQJfUE6l81IZVXW0I9aA8ybPRhUAF-AcDESg4F3_4iBw
          - type: recall
            value: 0.8650962919021573
            name: Recall Macro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmRmNGExZjhhNzk5NGEyM2Q0ZjNjMWY0N2JjMjYyYjcwNmVmYzBlZjc0NDAyZmVkMTExY2Q1YWJlOWY5NDM5NCIsInZlcnNpb24iOjF9.wtquAcG7b1TRtzr0i6Hxp0jLKvzIUdlSGD5KHXmIs9ETws_0WnxWUCnRgsKHnqn1eaLq3VAKHjh8L2DC8uz6AA
          - type: recall
            value: 0.9185
            name: Recall Micro
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGNmNTRmYTYwOTYyMGE4ODA3MDRhOGRmOTAxYmQyNTUzMzg4MDc5NDljZDRkMWU4YjFhNGRkZTYwZWU1NjA0ZiIsInZlcnNpb24iOjF9.AGMYerLFebSy28Fc1N1c-zWIKNiWQRXYUlXUkugKyHPLjRFi368E_yvhZ82MhFgftpXPuRvawbRf3qMbC3u6Ag
          - type: recall
            value: 0.9185
            name: Recall Weighted
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTU1ODk4M2M3MThmNjE1ZTNjOWFlNWQ5MGU5OWQ3YjEzZmI0ZDY1MzNhMGFhMTgyYTIzZDRkNzI1MDZjNjg1ZCIsInZlcnNpb24iOjF9.qAuYR2tT7Qsn5f6vZif0S2SajuICcIH5rQQ2Np7ISqJsOW15EMQuFP38A4VmGUeJbhGMweNymanoayKeL5wOCA
          - type: loss
            value: 0.20907790958881378
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTc2ZDI3MjJiMmQyYjU3ZTI3ODY3YjlhZDI3NjYxNzIzMTNhY2Y5NWQ5ZWJiZTMwMjEzNGMwNGIyYzdhNmVhNCIsInZlcnNpb24iOjF9.uRPycZKatfwTpGEwV_P4zqvUX46b8nnK00GnEhjzSs_AVQ08AybYNFWtrZIR3QrE1QxmwvnmgWg1yLD8daqqCg
          - type: matthews_correlation
            value: 0.8920254536671932
            name: matthews_correlation
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTEyMDMzM2IwNjdhZGI4NTdmNWM4Y2E3ZDIzMGRlZjY1NjU4YzhhNWE3NzQxMmY4MmNkYTg4NDliYzg1NTJkZCIsInZlcnNpb24iOjF9.qf0k31A_Gnrq742IInObfr3xGQtAhFtmkMJRTO8GDimKyaSQHtY6UrKUM2LWf9wIYKjN70XIA34m749fD1udAQ

multi-class-classification

This model is a fine-tuned version of distilbert-base-uncased on the emotion dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2009
  • Accuracy: 0.928

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 1

Training results

Training Loss Epoch Step Validation Loss Accuracy
0.2643 1.0 1000 0.2009 0.928

Framework versions

  • Transformers 4.19.2
  • Pytorch 1.11.0+cu113
  • Datasets 2.2.2
  • Tokenizers 0.12.1