FredNajjar
commited on
Commit
•
a9a2cb0
1
Parent(s):
8255ca6
Update README.md
Browse files
README.md
CHANGED
@@ -10,6 +10,8 @@ datasets:
|
|
10 |
metrics:
|
11 |
- f1
|
12 |
- exact_match
|
|
|
|
|
13 |
---
|
14 |
|
15 |
# FredNajjar/bigbird-QA-squad_v2.2
|
@@ -22,12 +24,7 @@ Fine-tuned [`google/bigbird-roberta-base`](https://huggingface.co/google/bigbird
|
|
22 |
- **Task**: Extractive QA
|
23 |
- **Training Data**: [SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/)
|
24 |
- **Eval Data**: [SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/)
|
25 |
-
- **
|
26 |
-
- Transformers: 4.34.0
|
27 |
-
- Pytorch: 2.0.1+cu118
|
28 |
-
- Datasets: 2.14.5
|
29 |
-
- Tokenizers: 0.14.1
|
30 |
-
- **Infrastructure**: 1x Tesla A100
|
31 |
|
32 |
## Training Hyperparameters
|
33 |
- Learning Rate: 3e-05
|
@@ -56,10 +53,17 @@ QA_input = {
|
|
56 |
res = nlp(QA_input)
|
57 |
```
|
58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
59 |
## Limitations and Bias
|
60 |
This model inherits limitations and potential biases from the base BigBird model and the SQuAD 2.0 training data.
|
61 |
|
62 |
## Contact
|
63 |
For inquiries, please reach out via [LinkedIn](https://www.linkedin.com/in/frednajjar/).
|
64 |
|
65 |
-
|
|
|
|
10 |
metrics:
|
11 |
- f1
|
12 |
- exact_match
|
13 |
+
library_name: adapter-transformers
|
14 |
+
pipeline_tag: question-answering
|
15 |
---
|
16 |
|
17 |
# FredNajjar/bigbird-QA-squad_v2.2
|
|
|
24 |
- **Task**: Extractive QA
|
25 |
- **Training Data**: [SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/)
|
26 |
- **Eval Data**: [SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/)
|
27 |
+
- **Infrastructure**: 1x NVIDIA A100-SXM4-40GB
|
|
|
|
|
|
|
|
|
|
|
28 |
|
29 |
## Training Hyperparameters
|
30 |
- Learning Rate: 3e-05
|
|
|
53 |
res = nlp(QA_input)
|
54 |
```
|
55 |
|
56 |
+
- **Framework Versions**:
|
57 |
+
- Transformers: 4.34.0
|
58 |
+
- Pytorch: 2.0.1+cu118
|
59 |
+
- Datasets: 2.14.5
|
60 |
+
- Tokenizers: 0.14.1
|
61 |
+
|
62 |
## Limitations and Bias
|
63 |
This model inherits limitations and potential biases from the base BigBird model and the SQuAD 2.0 training data.
|
64 |
|
65 |
## Contact
|
66 |
For inquiries, please reach out via [LinkedIn](https://www.linkedin.com/in/frednajjar/).
|
67 |
|
68 |
+
|
69 |
+
---
|