论文平台收录高光谱地物分类卷积神经网络高光谱影像曼巴状态空间模型自注意力变换器编码器解码器网络
DEMUNet: Dual Encoder Mamba U-Net for Hyperspectral Image Classification
DEMUNet:用于高光谱图像分类的双编码器曼巴编码器解码器网络
Xiandai Cui; Li Zhang
- Journal / Publication
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 时间暂未填写
论文摘要
Accurate classification and recognition of hyperspectral images (HSIs) represent a crucial task in remote sensing image processing. The transformer has emerged as a dominant method for HSI classification due to its powerful global modeling capabilities. However, the quadratic complexity associated with the self-attention mechanism poses significant challenges in terms of memory consumption and computational efficiency. Although the recently proposed Mamba model offers a potential solution to these issues, its scanning strategy struggles to effectively capture the correlations between central pixels and their surroundings, thereby limiting feature representation. To overcome these limitations, this work introduces the dual encoder mamba U-Net (DEMUNet), which achieves spatial–spectral long-range dependency modeling at linear complexity. Specifically, the cross-scan Mamba module overcomes the unidirectional scanning restrictions of the original Mamba model, enabling multidirectional perception of image context to enhance spatial–spectral feature extraction. Additionally, the dual-path encoder module utilizes a dual-branch structure combining CNN and transformer blocks, integrated with an adaptive feature fusion strategy to merge local details with global contextual information. Experimental results on commonly used hyperspectral datasets, including Indian Pines, Pavia University, Houston 2013, as well as the ZY-1 02D dataset, demonstrate that DEMUNet surpasses other state-of-the-art models, achieving impressive classification accuracies of 98.56%, 99.60%, 99.61%, and 97.29%, respectively. Codes are available at https://github.com/cuixiandai/DEMUNet.
