m-newhauser
commited on
Commit
•
ec2d6f0
1
Parent(s):
1ed814c
Update README.md
Browse files
README.md
CHANGED
@@ -13,4 +13,21 @@ metrics:
|
|
13 |
- recall
|
14 |
---
|
15 |
|
16 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
- recall
|
14 |
---
|
15 |
|
16 |
+
# distilbert-political-tweets
|
17 |
+
|
18 |
+
🗣 🇺🇸 Classify sentiment as Democratic or Republican.
|
19 |
+
|
20 |
+
# Model
|
21 |
+
|
22 |
+
[DistilBERT base model (uncased)](https://huggingface.co/distilbert-base-uncased) for sequence classification fine-tuned on ~10,000 randomly selected tweets from Democratic and Republican senators from FiveThirtyEight's [twitter-ratio/senators](https://fivethirtyeight.datasettes.com/fivethirtyeight/twitter-ratio%2Fsenators#export) dataset.
|
23 |
+
|
24 |
+
# Evaluation
|
25 |
+
|
26 |
+
The model was evaluated on a validation dataset of ~3,000 unseen random tweets:
|
27 |
+
```python
|
28 |
+
{'eval_accuracy': 0.9348,
|
29 |
+
'eval_f1': 0.9386,
|
30 |
+
'eval_loss': 0.1975,
|
31 |
+
'eval_precision': 0.9281,
|
32 |
+
'eval_recall': 0.9494}
|
33 |
+
```
|