Spatial-Spectral 1DSwin Transformer With Groupwise Feature Tokenization for Hyperspectral Image Classification

文献类型： 外文期刊

第一作者： Xu, Yifei

作者： Xu, Yifei;Xie, Yixuan;Li, Bicheng;Zhu, Li;Xie, Chuanqi;Zhang, Yongchuan;Wang, Aichen

作者机构：

关键词： 1-D shifted window-based multihead self-attention (1DSW-MSA); 1-D window-based MSA (1DW-MSA); cross-block normalized connection (CNC); hyperspectral image (HSI) classification; Swin Transformer

期刊名称：IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING （ 影响因子：8.2； 五年影响因子：8.8 ）

ISSN： 0196-2892

年卷期： 2023 年 61 卷

页码：

收录情况： SCI

摘要： The hyperspectral image (HSI) classification aims to assign each pixel to a land-cover category. It is receiving increasing attention from both industry and academia. The main challenge lies in capturing reliable and informative spatial and spectral dependencies concealed in the HSI for each class. To address the challenge, we propose a spatial-spectral 1DSwin (SS1DSwin) Transformer with groupwise feature tokenization for HSI classification. Specifically, we reveal local and hierarchical spatial-spectral relationships from two different perspectives. It mainly consists of a groupwise feature tokenization module (GFTM) and a 1DSwin Transformer with cross-block normalized connection module (TCNCM). For GFTM, we reorganize an image patch into overlapping cubes and further generate groupwise token embeddings with multihead self-attention (MSA) to learn the local spatial-spectral relationship along the spatial dimension. For TCNCM, we adopt the shifted windowing strategy when acquiring the hierarchical spatial-spectral relationship along the spectral dimension with 1-D window-based MSA (1DW-MSA) and 1-D shifted window-based MSA (1DSW-MSA) and leverage cross-block normalized connection (CNC) to adaptively fuse the feature maps from different blocks. In SS1DSwin, we apply these two modules in order and predict the class label for each pixel. To test the effectiveness of the proposed method, extensive experiments are conducted on four HSI datasets, and the results indicate that SS1DSwin outperforms several current state-of-the-art methods. The source code of the proposed method is available at https://github.com/Minato252/SS1DSwin.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序