README.md

---
library_name: transformers
license: apache-2.0
datasets:
- Private
language:
- en
metrics:
- accuracy
- precision
- recall
- f1
base_model: google-bert/bert-base-uncased
pipeline_tag: text-classification
---

# Model Card for Model ID

This is a fine-tuned BERT model (`bert-base-uncased`) used for classifying text into two categories: **Depression** or **Non-depression**. The model is designed for text classification and has been trained on a custom dataset of mental health-related posts from social media.


### Model Description

This model aims to identify signs of depression in written text. It was trained on social media posts labeled as either indicative of depression or not. The model uses the BERT architecture for text classification and was fine-tuned specifically for this task. 

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

- **Developed by:** Ashish Poudel
- **Model type:** Text Classification
- **Language(s) (NLP):** English (`en`)
- **License:** `apache-2.0`
- **Finetuned from model:** `apache-2.0`

### Model Sources [optional]


- **Repository:** [Sentiment Classifier for Depression](https://huggingface.co./poudel/sentiment-classifier)
- **Demo [optional]:** [Live Gradio App](https://huggingface.co./spaces/poudel/Sentiment_classifier)


### Use

This model is designed to classify text as either depression-related or non-depression-related. It can be used in social media sentiment analysis, mental health research, and automated text analysis systems. 


### Downstream Use 

The model can be further fine-tuned for other types of sentiment analysis tasks related to mental health. 


### Out-of-Scope Use

The model should not be used for clinical diagnosis or decision-making without the input of medical professionals. It is also unsuitable for text that is not in English or very short/ambiguous inputs.



## Bias, Risks, and Limitations
 The model may suffer from biases inherent in the dataset, such as overrepresenting certain language patterns. It is trained on social media posts, which may not capture all the nuances of real-world conversations about mental health 


### Recommendations

 Users should use the model with caution in sensitive applications such as mental health monitoring. It is advised that the model be used alongside professional judgment. 


## How to Get Started with the Model

```python
from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("poudel/sentiment-classifier")
tokenizer = AutoTokenizer.from_pretrained("poudel/sentiment-classifier")

inputs = tokenizer("I feel hopeless.", return_tensors="pt")
outputs = model(**inputs)
predicted_class = torch.argmax(outputs.logits).item()


## Training Details

### Training Data

 The model was trained on a custom dataset of tweets labeled as either depression-related or not. Data pre-processing included tokenization and removal of special characters. 


### Training Procedure

The model was trained using Hugging Face's transformers library. The training was conducted on a T4 GPU over 3 epochs, with a batch size of 16 and a learning rate of 5e-5. 

#### Preprocessing

 Text was lowercased, and special characters were removed as well as Tokenization was done using the bert-base-uncased tokenizer.


#### Training Hyperparameters

- **Training regime:** fp32 
- **Epochs:** 3 
- **Learning rate:** 5e-5
- **Batch size:** 16 

#### Speeds, Sizes, Times 

Training was conducted for approximately 1 hour on a T4 GPU in Google Colab.




#### Evaluation and Testing Data

 The model was evaluated on a 20% holdout set from the custom dataset. 


#### Metrics
The model was evaluated using accuracy, precision, recall, and F1 score.


### Results

Accuracy: 99.87%
Precision: 99.91%
Recall: 99.81%
F1 Score: 99.86% 

#### Summary
The model achieved high performance across all key metrics, indicating strong predictive capabilities for the text classification task.



## Environmental Impact

<!-- Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

- **Hardware Type:** [T4 GPU]
- **Hours used:** [ 1 hour]
- **Cloud Provider:** [Google Cloud (Colab)]
- **Carbon Emitted:** [Estimated at 0.45 kg CO2eq]

## Technical Specifications 

The model uses the BERT (bert-base-uncased) architecture and was fine-tuned for binary classification (depression vs non-depression).

### Model Architecture and Objective

#### Hardware

T4 GPU

#### Software
Hugging Face transformers library.

## Citation [optional]

 If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section.

**BibTeX:**

[@misc{poudel2024sentimentclassifier,
  author = {Poudel, Ashish},
  title = {Sentiment Classifier for Depression},
  year = {2024},
  url = {https://huggingface.co./poudel/sentiment-classifier},
}
]

**APA:**

Poudel, A. (2024). Sentiment Classifier for Depression. Retrieved from https://huggingface.co./poudel/sentiment-classifier.


## Model Card Authors 

[Ashish Poudel]

## Model Card Contact

[email protected]