Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: "en"
|
3 |
+
thumbnail: "https://huggingface.co/nsi319"
|
4 |
+
tags:
|
5 |
+
- distilbert
|
6 |
+
- pytorch
|
7 |
+
- text-classification
|
8 |
+
- mobile
|
9 |
+
- app
|
10 |
+
- descriptions
|
11 |
+
- playstore
|
12 |
+
- multi-class
|
13 |
+
- classification
|
14 |
+
liscence: "mit"
|
15 |
+
inference: true
|
16 |
+
---
|
17 |
+
|
18 |
+
# Mobile App Classification
|
19 |
+
|
20 |
+
## Model description
|
21 |
+
|
22 |
+
DistilBERT is a transformers model, smaller and faster than BERT, which was pre-trained on the same corpus in a self-supervised fashion, using the BERT base model as a teacher.
|
23 |
+
|
24 |
+
The [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) model is fine-tuned to classify an mobile app description into one of **6 play store categories**.
|
25 |
+
Trained on 9000 samples of English App Descriptions and associated categories of apps available in [Google Play](https://play.google.com/store/apps).
|
26 |
+
|
27 |
+
## Fine-tuning
|
28 |
+
|
29 |
+
The model was fine-tuned for 5 epochs with a batch size of 16, a learning rate of 2e-05, and a maximum sequence length of 512. Since this was a classification task, the model was trained with a cross-entropy loss function. The best evaluation f1 score achieved by the model was 0.9034534096919489, found after 4 epochs. The accuracy of the model on the test set was 90.33.
|
30 |
+
|
31 |
+
## How to use
|
32 |
+
|
33 |
+
```python
|
34 |
+
from transformers import AutoTokenizer, AutoModelForSequenceClassification, pipeline
|
35 |
+
|
36 |
+
tokenizer = AutoTokenizer.from_pretrained("nsi319/distilbert-base-uncased-finetuned-app")
|
37 |
+
model = AutoModelForSequenceClassification.from_pretrained("nsi319/distilbert-base-uncased-finetuned-app")
|
38 |
+
|
39 |
+
classifier = pipeline('sentiment-analysis', model=model, tokenizer=tokenizer)
|
40 |
+
|
41 |
+
classifier("From scores to signings, the ESPN App is here to keep you updated. Never miss another sporting moment with up-to-the-minute scores, latest news & a range of video content. Sign in and personalise the app to receive alerts for your teams and leagues. Wherever, whenever; the ESPN app keeps you connected.")
|
42 |
+
|
43 |
+
'''Output'''
|
44 |
+
[{'label': 'Sports', 'score': 0.9959789514541626}]
|
45 |
+
```
|
46 |
+
|
47 |
+
## Limitations
|
48 |
+
Training data consists of apps from 6 play store categories namely Education, Entertainment, Productivity, Sports, News & Magazines and Photography.
|
49 |
+
|