论文平台收录未分类未分类地面采样距离遥感基础模型曼巴状态空间模型自回归预训练地面采样距离感知表示学习

GSMamba: GSD-Aware Autoregressive Pretraining for Mamba-Based Remote Sensing Foundation Models

GSMamba:面向曼巴遥感基础模型的地面采样距离感知自回归预训练

Yajie Yang; Haoke Zhan; Jinhai Li; Luqing Luo
Journal / Publication
IEEE Geoscience and Remote Sensing Letters
Published
时间暂未填写

论文摘要

Remote sensing (RS) foundation models (RSFMs) largely rely on self-supervised pretraining to improve downstream performance. The recent combination of Mamba and autoregressive pretraining offers an efficient direction for RS representation learning, yet existing methods process images at fixed pixel units and overlook the physical-semantic misalignment caused by varying ground sampling distance (GSD). To address this issue, we propose GSMamba, a GSD-aware autoregressive pretraining framework for Mamba-based RSFMs. At the data level, GSD-aware spatial resampling aligns inputs to an explicitly specified target GSD. At the feature level, Scale-Conditioned Channel Modulation (SCCM) and GSD-conditioned encoding (GSD CE) calibrate resampling-induced feature shifts and inject GSD information. During inference, GSMamba supports on-demand target GSD specification for controllable accuracy-computation trade-offs. Experiments show that GSMamba achieves consistent gains over RoMA and stronger adaptation under downstream GSD shifts.

论文标识

成果类型
论文