Journal of Atmospheric and Environmental Optics ›› 2023, Vol. 18 ›› Issue (4): 371-382.

Previous Articles     Next Articles

Cloud detection of GF-5 remote sensing image based on multimodal fusion

ZHANG Sugui 1,2, ZHANG Jingjing 1,2*, XUN Lina 1,2, SUN Xiaobing 3, XIONG Wei 3, YAN Qing 1,2, LI Sui 4   

  1. 1 Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Anhui University, Hefei 230601, China; 2 School of Electrical Engineering and Automation, Anhui University, Hefei 230601, China; 3 Key Laboratory of Optical Calibration and Characterization, Chinese Academy of Sciences, Hefei 230031, China; 4 Anhui Wenda University of Information Engineering, Hefei 231201, China
  • Received:2022-10-31 Revised:2023-01-19 Online:2023-07-28 Published:2023-08-14
  • Contact: Jingjing ZHANG JingjingZhang E-mail:874878644@qq.com

Abstract: Cloud detection is of great significance for the application of remote sensing images. However, as for the existing cloud detection methods, there is limited research on the polarization information of remote sensing images, and their performance and generalization ability are also limited. To effectively utilize the polarization information of remote sensing images, a multimodal fusion remote sensing image cloud detection method based on depth learning is proposed and its preliminary experimental evaluation is conducted. In the method, the network is a three-parameter input stream architecture with an encoderdecoder structure, and the channel-spatial attention module is used to perfom multimodal fusion of reflectance and polarization features in remote sensing images. In the upsampling stage of the decoder, the iterative attention feature fusion method is used to fuse the high- and low-level feature maps. The evaluation experimental data set comes from Directional Polarization Camera (DPC) cloud products and cloud mask products. The evaluation results show that the proposed network model achieves good cloud detection performance, with a recognition accuracy of 93.91%.

Key words: cloud detection, polarization information, multimodal fusion, channel-spatial attention; iterative attention feature fusion

CLC Number: