RyanWy commited on
Commit
d1b4298
·
verified ·
1 Parent(s): 84a3c04

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -6,19 +6,19 @@ tags:
6
  ---
7
  # HSIMAE: A Unified Masked Autoencoder with large-scale pretraining for Hyperspectral Image Classification
8
 
9
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65979dfeb4b5c254cb8ed20e/vyn81w5ZnXWifmbX8By6T.png)
10
 
11
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65979dfeb4b5c254cb8ed20e/ItHlquQYMlzo8wVMt_aVh.png)
12
 
13
  ## ✨ Highlights
14
- ### Masked HSI Modeling with Large-Scale Pretraining
15
- The HSIMAE was pretrained by a large-scale HSI dataset, named HyspecNet-11k, then directly finetuned on four target classification datasets.
16
 
17
- ### Multi-Scale PCA for Features Extract
18
- To address these distributional shifts caused by the different spectral resolutions and spectral ranges between hyperspectral sensors, a MS-PCA was used to extract the multi-scale features of HSI spectra and transform the raw spectra into fixed-length features.
19
 
20
  ### Dual-branch finetuning to leverage unlabeled data of target dataset
21
- Dual-branch finetuning framework was proposed by using an extra unlabeled branch to further adapted the model to the distributions of the target dataset and suppressed the overfitting issue.
22
 
23
  ## 🧑‍💻 Contact
24
 
 
6
  ---
7
  # HSIMAE: A Unified Masked Autoencoder with large-scale pretraining for Hyperspectral Image Classification
8
 
9
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65979dfeb4b5c254cb8ed20e/YjbxlXg5el3nySkcQkmq_.png)
10
 
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65979dfeb4b5c254cb8ed20e/dxLbojSBr4Kdt-cgA3su7.png)
12
 
13
  ## ✨ Highlights
14
+ ### Large-Scale and Diverse Dataset for HSI Pretraining
15
+ A large and diverse HSI dataset named HSIHybrid was curated for large-scale HSI pre-training. It consisted of 15 HSI datasets from different hyperspectral sensors. After splitting into image patches, a total of **4 million** HSI patches with a spatial size of 9×9 were obtained.
16
 
17
+ ### New MAE Architecture for HSI domain
18
+ A modified MAE named HSIMAE that utilized separate spatial-spectral encoders followed by fusion blocks to learn spatial correlation and spectral correlation of HSI data was proposed.
19
 
20
  ### Dual-branch finetuning to leverage unlabeled data of target dataset
21
+ A dual-branch fine-tuning framework was introduced to leverage the unlabeled data of the downstream HSI dataset and suppressed overfitting on small training samples.
22
 
23
  ## 🧑‍💻 Contact
24