|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
base_model: albert-base-v2 |
|
tags: |
|
- generated_from_trainer |
|
metrics: |
|
- accuracy |
|
--- |
|
|
|
# Model Card for Model ID |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
Fine tuned model to classify customer support request |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
- **Model type:** ALBERT |
|
- **Language(s) (NLP):** English |
|
- **License:** apache-2.0 |
|
- **Finetuned from model :** https://huggingface.co./vineetsharma/customer-support-intent-albert |
|
|
|
## Uses |
|
|
|
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. --> |
|
|
|
## How to Get Started with the Model |
|
|
|
Use the code below to get started with the model. |
|
|
|
[More Information Needed] |
|
|
|
## Training Details |
|
|
|
### Training Data |
|
|
|
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. --> |
|
|
|
https://huggingface.co./datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset |
|
|
|
### Training Procedure |
|
|
|
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. --> |
|
https://colab.research.google.com/drive/1RllMjMO_41l0pf0di1guQePpl97Z6M9A#scrollTo=SVjaVFshS-ox |
|
|
|
#### Preprocessing [optional] |
|
|
|
Dividing dataset 80/20% for finetuning and evaluation |
|
|
|
|
|
#### Training Hyperparameters |
|
|
|
- evaluation_strategy:epoch |
|
- learning_rate: 2e-5 |
|
- per_device_train_batch_size: 16 |
|
- per_device_eval_batch_size: 16 |
|
- num_train_epochs: 3 |
|
- weight_decay: 0.01 |
|
|
|
## Metrics & Evaluation |
|
|
|
<!-- This section describes the evaluation protocols and provides the results. --> |
|
|
|
- eval_loss: 0.005226992070674896 |
|
- eval_accuracy: 0.9990697674418605 |
|
- eval_runtime: 10.7178 |
|
- eval_samples_per_second: 501.504 |
|
- eval_steps_per_second: 31.35 |
|
- epoch: 3.0 |
|
|
|
### Testing Data, Factors & Metrics |
|
|
|
#### Testing Data |
|
|
|
<!-- This should link to a Dataset Card if possible. --> |
|
|
|
20% of "https://huggingface.co./vineetsharma/customer-support-intent-albert" dataset |
|
|
|
|
|
accuracy |
