Graph Machine Learning
AnemoI
English
jpxkqx commited on
Commit
1a3c942
·
verified ·
1 Parent(s): ad5739c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -19
README.md CHANGED
@@ -41,20 +41,20 @@ More detailed information about the new parameters introduced with AIFS Single v
41
 
42
  | Short Name | Name | Units | Component Type | Lev.Type |
43
  |:----------:|:----:|:-----:|:--------------:|:--------:|
44
- | swl1 | Volumetric soil water layer 1 | $m^3 m^{-3}$ | HRES | sfc |
45
- | swl2 | Volumetric soil water layer 2 | $m^3 m^{-3}$ | HRES | sfc |
46
- | stl1 | Soil temperature level 1 | $K$ | HRES | sfc |
47
- | stl2 | Soil temperature level 2 | $K$ | HRES | sfc |
48
- | 100u | 100 metre U wind component | $m s^{-1}$ | HRES | sfc |
49
- | 100v | 100 metre V wind component | $m s^{-1}$ | HRES | sfc |
50
- | ssrd | Surface short-wave (solar) radiation downwards | $J m^{-2}$ | HRES | sfc |
51
- | strd | Surface long-wave (thermal) radiation downwards | $J m^{-2}$ | HRES | sfc |
52
- | tcc | Total cloud cover | $(0 - 1)$ | HRES | sfc |
53
- | hcc | High Cloud Cover | $(0 - 1)$ | HRES | sfc |
54
- | mcc | Medium Cloud Cover | $(0 - 1)$ | HRES | sfc |
55
- | lc | Low cloud cover | $(0 - 1)$ | HRES | sfc |
56
- | ro | Runoff | $m$ | HRES | sfc |
57
- | sf | Snowfall | $m$ of water equivalent | HRES | sfc |
58
 
59
 
60
  #### Changes to existing parameters
@@ -171,22 +171,22 @@ to the fact that for AIFS Single v0.2.1 we used just operational-analysis data f
171
  release we have done the fine-tunning from 2016 to 2022.
172
 
173
  The other important change in the fine-tuning stage is that for AIFS Single v0.2.1 after the 6hr model training the
174
- optimiser was not restarted (ie. rollout was done with the minimal lr of $3 × 10^{-7}$). For this release we have seen
175
  that restarting the optimiser for the rollout improves the model's performance. For the operational-fine tuning rollout
176
  stage, the learning rate cycle is restarted, gradually decreasing to the minimum value at the end of rollout.
177
 
178
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
179
 
180
  - **Pre-training**: It was performed on ERA5 for the years 1979 to 2022 with a cosine learning rate (LR) schedule and a
181
- total of 260,000 steps. The LR is increased from 0 to $10^{-4}$ during the first 1000 steps, then it is annealed to a
182
- minimum of $3 × 10^{-7}$. The local learning rate used for this stage is $3.125 × 10^{-5}$.
183
  - **Fine-tuning**: The pre-training is then followed by rollout on operational real-time IFS NWP analyses for the years
184
- 2016 to 2022, this time with a local learning rate of $8 × 10^{−7}$, which is decreased to $3 × 10^{−7}$. Rollout steps
185
  increase per epoch. In this second stage the warm up period of the optimiser is 100 steps to account for shorter length
186
  of this stage. Optimizer step are equal to 7900 ( 12 epoch with ~630 steps per epoch).
187
 
188
  As in the previous version of aifs-single for fine-tuning and initialisation of the model during inference, IFS fields
189
- are interpolated from their native O1280 resolution (approximately $0.1°$) down to N320 (approximately $0.25°$).
190
 
191
  #### Training Hyperparameters
192
 
 
41
 
42
  | Short Name | Name | Units | Component Type | Lev.Type |
43
  |:----------:|:----:|:-----:|:--------------:|:--------:|
44
+ | swl1 | Volumetric soil water layer 1 | \\(m^3 m^{-3}\\) | HRES | sfc |
45
+ | swl2 | Volumetric soil water layer 2 | \\(m^3 m^{-3}\\) | HRES | sfc |
46
+ | stl1 | Soil temperature level 1 | \\(K\\) | HRES | sfc |
47
+ | stl2 | Soil temperature level 2 | \\(K\\) | HRES | sfc |
48
+ | 100u | 100 metre U wind component | \\(m s^{-1}\\) | HRES | sfc |
49
+ | 100v | 100 metre V wind component | \\(m s^{-1}\\) | HRES | sfc |
50
+ | ssrd | Surface short-wave (solar) radiation downwards | \\(J m^{-2}\\) | HRES | sfc |
51
+ | strd | Surface long-wave (thermal) radiation downwards | \\(J m^{-2}\\) | HRES | sfc |
52
+ | tcc | Total cloud cover | \\((0 - 1)\\) | HRES | sfc |
53
+ | hcc | High Cloud Cover | \\((0 - 1)\\) | HRES | sfc |
54
+ | mcc | Medium Cloud Cover | \\((0 - 1)\\) | HRES | sfc |
55
+ | lc | Low cloud cover | \\((0 - 1)\\) | HRES | sfc |
56
+ | ro | Runoff | \\(m\\) | HRES | sfc |
57
+ | sf | Snowfall | \\(m\\) of water equivalent | HRES | sfc |
58
 
59
 
60
  #### Changes to existing parameters
 
171
  release we have done the fine-tunning from 2016 to 2022.
172
 
173
  The other important change in the fine-tuning stage is that for AIFS Single v0.2.1 after the 6hr model training the
174
+ optimiser was not restarted (ie. rollout was done with the minimal lr of \\(3 × 10^{-7}\\)). For this release we have seen
175
  that restarting the optimiser for the rollout improves the model's performance. For the operational-fine tuning rollout
176
  stage, the learning rate cycle is restarted, gradually decreasing to the minimum value at the end of rollout.
177
 
178
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
179
 
180
  - **Pre-training**: It was performed on ERA5 for the years 1979 to 2022 with a cosine learning rate (LR) schedule and a
181
+ total of 260,000 steps. The LR is increased from 0 to \\(10^{-4}\\) during the first 1000 steps, then it is annealed to a
182
+ minimum of \\(3 × 10^{-7}\\). The local learning rate used for this stage is \\(3.125 × 10^{-5}\\).
183
  - **Fine-tuning**: The pre-training is then followed by rollout on operational real-time IFS NWP analyses for the years
184
+ 2016 to 2022, this time with a local learning rate of \\(8 × 10^{−7}\\), which is decreased to \\(3 × 10^{−7}\\). Rollout steps
185
  increase per epoch. In this second stage the warm up period of the optimiser is 100 steps to account for shorter length
186
  of this stage. Optimizer step are equal to 7900 ( 12 epoch with ~630 steps per epoch).
187
 
188
  As in the previous version of aifs-single for fine-tuning and initialisation of the model during inference, IFS fields
189
+ are interpolated from their native O1280 resolution (approximately \\(0.1°\\)) down to N320 (approximately \\(0.25°\\)).
190
 
191
  #### Training Hyperparameters
192