Update README.md
Browse files
README.md
CHANGED
|
@@ -49,6 +49,19 @@ lora_config = LoraConfig(
|
|
| 49 |
)
|
| 50 |
```
|
| 51 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
### Hardware
|
| 53 |
- RTX 3090 Ti 24GB x 1
|
| 54 |
- Training Time : 1 hours
|
|
|
|
| 49 |
)
|
| 50 |
```
|
| 51 |
|
| 52 |
+
### Model evaluation
|
| 53 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 54 |
+
|----------------|------:|------|-----:|--------|---|-----:|---|------|
|
| 55 |
+
|kobest_boolq | 1|none | 0|acc |↑ |0.5150|± |0.0133|
|
| 56 |
+
| | |none | 0|f1 |↑ |0.3634|± | N/A|
|
| 57 |
+
|kobest_copa | 1|none | 0|acc |↑ |0.6280|± |0.0153|
|
| 58 |
+
| | |none | 0|f1 |↑ |0.6279|± | N/A|
|
| 59 |
+
|kobest_hellaswag| 1|none | 0|acc |↑ |0.4280|± |0.0221|
|
| 60 |
+
| | |none | 0|acc_norm|↑ |0.5540|± |0.0223|
|
| 61 |
+
| | |none | 0|f1 |↑ |0.4250|± | N/A|
|
| 62 |
+
|kobest_sentineg | 1|none | 0|acc |↑ |0.7406|± |0.0220|
|
| 63 |
+
| | |none | 0|f1 |↑ |0.7317|± | N/A|
|
| 64 |
+
|
| 65 |
### Hardware
|
| 66 |
- RTX 3090 Ti 24GB x 1
|
| 67 |
- Training Time : 1 hours
|