NightMachinery commited on
Commit
efeb803
1 Parent(s): 56e661e

Model save

Browse files
Files changed (3) hide show
  1. README.md +13 -2
  2. adapter_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,6 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
  # my_awesome_qa_model
17
 
18
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the squad dataset.
 
 
19
 
20
  ## Model description
21
 
@@ -35,13 +37,22 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
- - train_batch_size: 64
39
- - eval_batch_size: 64
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - num_epochs: 3
44
 
 
 
 
 
 
 
 
 
 
45
  ### Framework versions
46
 
47
  - Transformers 4.32.1
 
16
  # my_awesome_qa_model
17
 
18
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the squad dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 5.3101
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
+ - train_batch_size: 40
41
+ - eval_batch_size: 40
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - num_epochs: 3
46
 
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:-----:|:----:|:---------------:|
51
+ | No log | 1.0 | 100 | 5.5239 |
52
+ | No log | 2.0 | 200 | 5.3671 |
53
+ | No log | 3.0 | 300 | 5.3101 |
54
+
55
+
56
  ### Framework versions
57
 
58
  - Transformers 4.32.1
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d2ae8a7fedf26729b1462e4684bbfcbe79371d8821898c6304b6c8d41a3e36e
3
  size 614532
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3a4723c5dce28dd11f064a0300b97ecab88cd863bdcaa6aa41fabd1c7516c79
3
  size 614532
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2dde198d88c8a95bd81581dbad2fd4f4b1e2cc16732e2f659cc9bdeb80998227
3
  size 4472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d5dc516c8aecbbbeaf57daa9147aaf6b8e1b77ef3b481134917532c040f18ae
3
  size 4472