---
library_name: transformers
license: apache-2.0
base_model: albert-base-v2
tags:
- generated_from_trainer
metrics:
- accuracy
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
Fine tuned model to classify customer support request  

## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

- **Model type:** ALBERT
- **Language(s) (NLP):** English
- **License:** apache-2.0
- **Finetuned from model :** https://huggingface.co./vineetsharma/customer-support-intent-albert

## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

## How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

https://huggingface.co./datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
https://colab.research.google.com/drive/1RllMjMO_41l0pf0di1guQePpl97Z6M9A#scrollTo=SVjaVFshS-ox

#### Preprocessing [optional]

Dividing dataset 80/20% for finetuning and evaluation


#### Training Hyperparameters

  - evaluation_strategy:epoch
  - learning_rate: 2e-5
  - per_device_train_batch_size: 16
  - per_device_eval_batch_size: 16
  - num_train_epochs: 3
  - weight_decay: 0.01

## Metrics & Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

 - eval_loss: 0.005226992070674896
 - eval_accuracy: 0.9990697674418605
 - eval_runtime: 10.7178
 - eval_samples_per_second: 501.504
 - eval_steps_per_second: 31.35
 - epoch: 3.0
 
### Testing Data, Factors & Metrics

#### Testing Data

<!-- This should link to a Dataset Card if possible. -->

20% of "https://huggingface.co./vineetsharma/customer-support-intent-albert" dataset


accuracy