计算机科学 ›› 2022, Vol. 49 ›› Issue (6): 193-198.doi: 10.11896/jsjkx.210500058

• 计算机图形学&多媒体 • 上一篇    下一篇

基于特征注意力融合网络的遥感变化检测研究

蓝凌翔, 池明旻   

  1. 复旦大学上海市数据科学重点实验室 上海 200438
  • 收稿日期:2021-05-10 修回日期:2021-06-04 出版日期:2022-06-15 发布日期:2022-06-08
  • 通讯作者: 池明旻(mmchi@fudan.edu.cn)
  • 作者简介:(lxlan18@fudan.edu.cn)
  • 基金资助:
    国家重点研发计划(2017YFA0402600);中国石油化工股份有限公司科技攻关项目(PE19003-3)

Remote Sensing Change Detection Based on Feature Fusion and Attention Network

LAN Ling-xiang, CHI Ming-min   

  1. Shanghai Key Laboratory of Data Science,Fudan University,Shanghai 200438,China
  • Received:2021-05-10 Revised:2021-06-04 Online:2022-06-15 Published:2022-06-08
  • About author:LAN Ling-xiang,born in 1996,postgraduate.His main research interests include deep learning,remote sensing and change detection.
    CHI Ming-min,born in 1976,Ph.D,associate professor.Her main research interests include data science,big data,and machine learning with applications to remote sensing,intelligent manufacturing,oil and gas exploration,compu-ter vision and astronomy.
  • Supported by:
    National Key R & D Program of China(2017YFA0402600) and Science and Technology Research Project of Sinopec(PE19003-3).

摘要: 变化检测是遥感的重要任务之一,通常被认为是像元级的分类问题。近年来,深度神经网络由于对双时相图像具有强大的层次表示能力,在变化检测中得到了广泛应用。文中基于编码器-融合-解码器框架,提出了一种基于特征注意力融合的变化检测网络(FFAN),其将编码器生成的特征与经由注意力机制增强后的双时相差异特征进行融合,以更好地捕获双时相变化信息。特别地,通过由注意力机制增强的双时相特征,可以显著增强深层网络中间层中变化信息的传播,该特征显式地建模双时相输入的相互依赖性并自适应地重新校准FFAN中的变化激活。在开源数据集上进行的实验表明,与现有方法相比,所提FFAN具有更优异的检测性能。

关键词: 变化检测, 深度学习, 特征融合, 遥感, 注意力机制

Abstract: Change detection is one of the essential tasks in remote sensing,which is usually regarded as a pixel-level classification problem.In recent years,deep neural networks have also been widely used in the change detection task due to their powerful hierarchical representation of bi-temporal images.A feature fusion and attention network (FFAN) is proposed based on neural encoder-fusion-decoder framework.It integrates features generated by encoder with the bi-temporal difference feature enhanced by attention mechanism,to better capture the bi-temporal change information.In particular,bi-temporal features enhanced by attention mechanism can significantly enhance the propagation of change information in the intermediate layers of deep networks,which adaptively recalibrates the change activation in FFAN by explicitly modeling the interdependence of bi-temporal inputs.Experiments conducted on open-source dataset demonstrate that,compared with existing methods,FFAN obtains better performance.

Key words: Attention mechanism, Change detection, Deep learning, Feature fusion, Remote sensing

中图分类号: 

  • TP391
[1] LIANG B,WENG Q.Assessing urban environmental qualitychange of Indianapolis,United States,by the remote sensing and GIS integration[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2010,4(1):43-55.
[2] LEI T,ZHANG Y,LV Z,et al.Landslide inventory mappingfrom bitemporal images using deep convolutional neural networks[J].IEEE Geoscience and Remote Sensing Letters,2019,16(6):982-986.
[3] LIU S,CHI M,ZOU Y,et al.Oil spill detection via multitemporal optical remote sensing images:A change detection perspective[J].IEEE Geoscience and Remote Sensing Letters,2017,14(3):324-328.
[4] QUARMBY N A,CUSHNIE J L.Monitoring urban land cover changes at the urban fringe from SPOT HRV imagery in south-east England[J].International Journal of Remote Sensing,1989,10(6):953-963.
[5] HOWARTH P J,WICKWARE G M.Procedures for change detection using Landsat digital data[J].International Journal of Remote Sensing,1981,2(3):277-291.
[6] CARVALHO J O A,GUIMARÃES R F,GILLESPIE A R,et al.A new approach to change vector analysis using distance and similarity measures[J].Remote Sensing,2011,3(11):2473-2493.
[7] JIN S,SADER S A.Comparison of time series tasseled cap wetness and the normalized difference moisture index in detecting forest disturbances[J].Remote sensing of Environment,2005,94(3):364-372.
[8] NIELSEN A A,CONRADSEN K,SIMPSON J J.Multivariatealteration detection (MAD) and MAF postprocessing in multispectral,bitemporal image data:New approaches to change detection studies[J].Remote Sensing of Environment,1998,64(1):1-19.
[9] DENG J S,WANG K,DENG Y H,et al.PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data[J].International Journal of Remote Sensing,2008,29(16):4823-4838.
[10] MANTERO P,MOSER G,SERPICO S B.Partially supervised classification of remote sensing images through SVM-based probability density estimation[J].IEEE Transactions on Geo-science and Remote Sensing,2005,43(3):559-570.
[11] IM J,JENSEN J R.A change detection model based on neighborhood correlation image analysis and decision tree classification[J].Remote Sensing of Environment,2005,99(3):326-340.
[12] ZHAO J,GONG M,LIU J,et al.Deep learning to classify diffe-rence image for image change detection[C]//International Joint Conference on Neural Networks.IEEE,2014:411-417.
[13] ZHANG H,GONG M,ZHANG P,et al.Feature-level change detection using deep representation and feature change analysis for multispectral imagery[J].IEEE Geoscience and Remote Sensing Letters,2016,13(11):1666-1670.
[14] WANG Q,YUAN Z,DU Q,et al.GETNET:A general end-to-end 2-D CNN framework for hyperspectral image change detection[J].IEEE Transactions on Geoscience and Remote Sensing,2018,57(1):3-13.
[15] EL AMIN A M,LIU Q,WANG Y.Convolutional neural network features based change detection in satellite images[C]//First International Workshop on Pattern Recognition.International Society for Optics and Photonics,2016.
[16] DAUDT R C,LE SAUX B,BOULCH A.Fully convolutionalsiamese networks for change detection[C]//International Confe-rence on Image Processing.IEEE,2018:4063-4067.
[17] LAN L,WU D,CHI M.Multi-temporal Change Detection based on Deep Semantic Segmentation Networks[C]//International Workshop on the Analysis of Multitemporal Remote Sensing Images.IEEE,2019:1-4.
[18] CHEN H,SHI Z.A spatial-temporal attention-based methodand a new dataset for remote sensing image change detection[J].Remote Sensing,2020,12(10):1662.
[19] ZHANG C,YUE P,TAPETE D,et al.A deeply supervisedimage fusion network for change detection in high resolution bi-temporal remote sensing images[J].ISPRS Journal of Photogrammetry and Remote Sensing,2020,6(166):183-200.
[20] PENG D,ZHANG Y,GUAN H.End-to-end change detectionfor high resolution satellite images using improved UNet++[J].Remote Sensing,2019,11(11):1382.
[21] CHEN L,ZHANG D,LI P,et al.Change Detection of RemoteSensing Images Based on Attention Mechanism[J].Computational Intelligence and Neuroscience,2020,(1):1-11.
[22] LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[C]//Computer Vision and Pattern Recognition.IEEE,2015:3431-3440.
[23] HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[24] WANG P,CHEN P,YUAN Y,et al.Understanding convolution for semantic segmentation[C]//Winter Conference on Applications of Computer Vision.IEEE,2018:1451-1460.
[25] HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Computer Vision and Pattern Recognition.IEEE,2018:7132-7141.
[26] LEBEDEV M A,VIZILTER Y V,VYGOLOV O V,et al.Change Detection in Remote Sensing Images Using Conditional Adversarial Networks[J].International Archives of the Photogrammetry,Remote Sensing & Spatial Information Sciences,2018,42(2):565-571.
[27] HE J,ZHANG C Q,LI X Z,et al.Survey of Research on Multimodal Fusion Technology for Deep Learning[J].Computer Engineering,2020,46(5):1-11.
[28] CHEN J,YUAN Z,PENG J,et al.DASNet:Dual attentive fully convolutional siamese networks for change detection of high re-solution satellite images[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2020,14:1194-1206.
[29] ZHOU B,KHOSLA A,LAPEDRIZA A,et al.Learning deep features for discriminative localization[C]//Computer Vision and Pattern Recognition.IEEE,2016:2921-2929.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 周芳泉, 成卫青.
基于全局增强图神经网络的序列推荐
Sequence Recommendation Based on Global Enhanced Graph Neural Network
计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[4] 戴禹, 许林峰.
基于文本行匹配的跨图文本阅读方法
Cross-image Text Reading Method Based on Text Line Matching
计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[5] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[6] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[7] 熊丽琴, 曹雷, 赖俊, 陈希亮.
基于值分解的多智能体深度强化学习综述
Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization
计算机科学, 2022, 49(9): 172-182. https://doi.org/10.11896/jsjkx.210800112
[8] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[9] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[10] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[11] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[12] 王坤姝, 张泽辉, 高铁杠.
基于Hachimoji DNA和QR分解的遥感图像可逆隐藏算法
Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition
计算机科学, 2022, 49(8): 127-135. https://doi.org/10.11896/jsjkx.210700216
[13] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[14] 闫佳丹, 贾彩燕.
基于双图神经网络信息融合的文本分类方法
Text Classification Method Based on Information Fusion of Dual-graph Neural Network
计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042
[15] 汪鸣, 彭舰, 黄飞虎.
基于多时间尺度时空图网络的交通流量预测模型
Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction
计算机科学, 2022, 49(8): 40-48. https://doi.org/10.11896/jsjkx.220100188
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!