A temporal-spatial deep learning network for winter wheat mapping using time-series Sentinel-2 imagery

文献类型： 外文期刊

第一作者： Fan, Lingling

作者： Fan, Lingling;Xia, Lang;Yang, Jing;Sun, Xiao;Wu, Shangrong;Wu, Wenbin;Yang, Peng;Fan, Lingling;Xia, Lang;Yang, Jing;Sun, Xiao;Wu, Shangrong;Wu, Wenbin;Fan, Lingling;Qiu, Bingwen;Chen, Jin

作者机构： Chinese Acad Agr Sci, Inst Agr Resources & Reg Planning, State Key Lab Efficient Utilizat Arid & Semiarid A, Beijing 100081, Peoples R China;Chinese Acad Agr Sci, Minist Agr & Rural Affairs, Inst Agr Resources & Reg Planning, Key Lab Agr Remote Sensing AGRO, Beijing 100081, Peoples R China;Chinese Acad Agr Sci, Agr Informat Inst, Beijing 100081, Peoples R China;Fuzhou Univ, Minist Educ, Sch Phys & Informat Engn, Key Lab Spatial Data Min & Informat Sharing, Fuzhou 350116, Fujian, Peoples R China;Beijing Normal Univ, Fac Geog Sci, Inst Remote Sensing Sci & Engn, State Key Lab Earth Surface Proc & Resource Ecol, Beijing 100875, Peoples R China

关键词： Wheat mapping; Deep learning; Temporal -spatial fusion; Time series; Sentinel-2

期刊名称：ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING （ 2023影响因子：10.6； 五年影响因子：11.8 ）

ISSN： 0924-2716

年卷期： 2024 年 214 卷

页码：

收录情况： SCI

摘要： Accurate mapping of winter wheat provides essential information for food security and ecosystem protection. Deep learning approaches have achieved promising crop discrimination performance based on multitemporal satellite imagery. However, due to the high dimensionality of the data, sequential relations, and complex semantic information in time-series imagery, effective methods that can automatically capture temporal -spatial features with high separability and generalizability have received less attention. In this study, we proposed a U-shaped CNN-Transformer hybrid framework based on an attention mechanism, named the U -TemporalSpatial -Transformer network (UTS-Former), for winter wheat mapping using Sentinel-2 imagery. This model includes an "encoder-decoder " structure for multiscale information mining of time series images and a temporalspatial transformer module (TST) for learning comprehensive temporal sequence features and spatial semantic information. The results obtained from two study areas indicated that our UTS-Former achieved the best accuracy, with a mean MCC of 0.928 and an F1 -score of 0.950, and the results of different band combinations also showed better performance than other popular time-series methods. We found that the MCC (MCC/All) of the UTS-Former using only RGB bands decreased by 4.53 %, while it decreased by 13.36 % and 35.02 % for UNet2dLSTM and CNN-BiLSTM, respectively, compared with that of all the band combinations. The comparison demonstrated that the proposed UTS-Former could capture more global temporal -spatial information from winter wheat fields and achieve greater precision in terms of local details than other methods, resulting in highquality mapping. The analysis of attention scores for the available acquisition dates revealed significant contributions of both beginning and ending growth images in winter wheat mapping, which is valuable for making appropriate selections of image dates. These findings suggest that the proposed approach has great potential for accurate, cost-effective, and high-quality winter wheat mapping.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序