Spaces:
Running
Running
Report for mrm8488/distilroberta-finetuned-financial-news-sentiment-analysis on financial_phrasebank (sentences_allagree, train set)
#1
by
giskard-bot
- opened
Robustness issues (1)
| Vulnerability | Level | Data slice | Metric | Transformation | Deviation | Description |
|---|---|---|---|---|---|---|
| Robustness | major | — | Fail rate = 0.301 | Transform to uppercase | 301/1000 tested samples (30.1%) changed prediction after perturbation | When feature “text” is perturbed with the transformation “Transform to uppercase”, the model changes its prediction in 30.1% of the cases. We expected the predictions not to be affected by this transformation. |