Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 220900264-6.doi: 10.11896/jsjkx.220900264

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Remote Sensing Image Fusion Method Combining Edge Detection and Parameter-adaptive PCNN

SHI Ying, HE Xinguang, LIU Binrui   

  1. School of Geographic Sciences,Hunan Normal University,Changsha 410081,China
    Key Laboratory of Geospatial Big Data Mining and Application,Hunan Province,Changsha 410081,China
  • Published:2023-11-09
  • About author:SHI Ying,born in 1998,postgraduate.Her main research interests include remote sensing image fusion and classification.
    HE Xinguang,born in 1973,Ph.D,professor.His main research interests include geographic spatiotemporal big data mining and application.
  • Supported by:
    Science and Technology Project from Department of Natural Resources of Hunan Province(2021-45).

Abstract: In order to improve the fusion quality of panchromatic(PAN) and multispectral(MS) images,and to solve the pro-blems of difficulty in parameter adjustment ofpulse coupled neural network(PCNN)and incomplete preservation of edge features of fused images,this paper proposes a remote sensing image fusion method by combining Canny operator and parameter-adaptive.Firstly,the MS image is converted into HSV color space to obtain thevalue(V) component,and the edge information of PAN image is distinguished to the non-edge by Canny operator.The edge of PAN image is enhanced by fusing the PAN image and V-component of MS image according to the characteristics of edge distribution.Then,the new PAN image and the V-component of MS image are respectively decomposed into their corresponding high-frequency and low-frequency coefficient bands by the nonsubsampled shearlet transform(NSST).The high-frequency bands are fused by a parametric-adaptive PCNN model,in which all the PCNN parameters can be estimated adaptively by the input frequency bands to obtain a PCNN model with optimal parameters.The low-frequency bands are fused by the method of selective weighted summation.Finally,the new V-component is obtained by inverse transform of NSST,and then the final fused image is achieved by inverse transform of HSV.The proposed method is compared with other recent methods,and seven objective evaluation indicators are selected to evaluate the spatial details and spectral information of the fusion image.Experimental results show that the proposed method can obtain better fusion performance with more advantages in visual quality and objective index evaluation.

Key words: Image fusion, Pulse coupled neural network, Canny operator, Shearlet transform, Parameter optimization

CLC Number: 

  • TP751
[1]ULLAH H,ZHAO Y Q,ABDALLA F,et al.Fast local Laplacian filtering based enhanced medical image fusion using para-meter-adaptive PCNN and local features-based fuzzy weighted matrices[J].Applied Intelligence,2021,2021,52(7):7965-7984.
[2]XU D D,WANG Y C,XU S Y,et al.Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network[J].Applied Sciences-Basel,2020,10(2):554.
[3]WANG C,ZHAO Z Y,REN Q Q,et al.A novel multi-focusimage fusion by combining simplified very deep convolutional networks and patch-based sequential reconstruction strategy[J].Applied Soft Computing,2020,91:106253.
[4]PAN Y T,LIU D F,WANG L G,et al.A Pan-SharpeningMethod with Beta-Divergence Non-Negative Matrix Factorization in Non-Subsampled Shear Transform Domain[J].Remote Sensing,2022,14(12):2921.
[5]LI S T,KANG X D,FANG L Y,et al.Pixel-level image fusion:A survey of the state of the art[J].Information Fusion,2017,33:100-112.
[6]LI H F,QIU H M,YU Z T,et al.Multifocus image fusion viafixed window technique of multiscale images and non-local means filtering[J].Signal Processing,2017,138:71-85.
[7]BAI X Z,LIU M M,CHEN Z G,et al.Multi-Focus Image Fusion Through Gradient-Based Decision Map Construction and Mathematical Morphology[J].IEEE Access,2016,4(99):4749-4760.
[8]FU J,LI W S,DU J,et al.Multimodal medical image fusion via laplacian pyramid and convolutional neural network reconstruction with local gradient energy strategy[J].Computers in Biology and Medicine,2020,126:104048.
[9]SINGH R,KHARE A.Fusion of multimodal medical imagesusing Daubechies complex wavelet transform-A multiresolution approach[J].Information Fusion,2014,19(1):49-60.
[10]WANG X H,BAI S F,LI Z,et al.The PAN and MS Image Pansharpening Algorithm Based on Adaptive Neural Network and Sparse Representation in the NSST Domain[J].IEEE Access,2019,7:52508-52521.
[11]SULAIMAN A G,ELASHMAWI W H,ELTAWEEL G S.IHS-based pan-sharpening technique for visual quality improvement using KPCA and enhanced SML in the NSCT domain[J].International Journal of Remote Sensing,2021,42(2):537-566.
[12]SMADI A A,YANG S Y,ABUGABAH A,et al.A Pansharpe-ning Based on the Non-Subsampled Contourlet Transform and Convolutional Autoencoder:Application to QuickBird Imagery[J].IEEE Access,2022,10:44778-44788.
[13]REINHARD E,HERBERT J R,ARNDT M,et al.FeatureLinking via Synchronization among Distributed Assemblies:Simulations of Results from Cat Visual Cortex[J].Neural Computation,1990,2(3):293-307.
[14] ZHANG K,HUANG Y D,ZHAO C.Remote sensing image fusion via RPCA and adaptive PCNN in NSST domain[J].International Journal of Wavelets,Multiresolution and Information Processing,2018,16(5):1850037.
[15]LI Y,ZHENG M Y,QI G Q,et al.A Novel Image FusionFramework Based on Sparse Representation and Pulse Coupled Neural Network[J].IEEE Access,2019,7:98290-98305.
[16]ZHANG L X,ZENG G P,WEI J J,et al.Multi-Modality Image Fusion in Adaptive-Parameters SPCNN Based on Inherent Cha-racteristics of Image[J].IEEE Sensors Journal,2020,20(20):11820-11827.
[17]CANNY J.A Computational Approach to Edge Detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1986,PAMI-8(6):679-698.
[18]GU Z P,HE X G.Multiscale remote sensing image fusion me-thod coupling edge detection and optimization[J].Computer Engineering and Applications,2017,53(11):192-198.
[19]CHEN Y L,PARK S K,MA Y,et al.A New Automatic Para-meter Setting Method of a Simplified PCNN for Image Segmentation[J].IEEE Transactions on Neural Networks and Learning Systems,2011,22(6):880-892.
[20]YIN M,LIU X N,LIU Y,et al.Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain[J].IEEE Transactions on Instrumentation and Measurement,2019,68(1):49-64.
[21] BAO C H,ZHU K,HE X G.Remote Sensing Image FusionMethod Based on Local Feature of Nonsubsampled Contourlet Coefficients[J].Computer Science,2014,41(03):310-313,319.
[22]BALASUBRAMANIAM P,ANANTHI V P.Image fusionusing intuitionistic fuzzy sets[J].Information Fusion,2014,20:21-30.
[23]JIN X,RENCAN N,ZHOU D M,et al.Multifocus Color Image Fusion Based on NSST and PCNN[J].Journal of Sensors,2016,2016:8359602.
[24]LI S T,LI C Y,KANG X D.Development status and future prospects of multi-source remote sensing image fusion[J].National Remote Sensing Bulletin,2021,25(1):148-166.
[25] TAN W,TIWARI P,PANDEY H M,et al.Multimodal medicalimage fusion algorithm in the era of big data[J].Neural Computing and Applications,2020,3:1-21.
[26]CHENG F F,FU Z T,HUANG L,et al.Non-subsampled shearlet transform remote sensing image fusion combined with parameter-adaptive PCNN[J].Acta Geodaetica et Cartographica Sinica,2021,50(10):1380-1389.
[1] HU Zhongyuan, XUE Yu, ZHA Jiajie. Survey on Evolutionary Recurrent Neural Networks [J]. Computer Science, 2023, 50(3): 254-265.
[2] WEI Qi, ZHAO Juan. Research Progress of Infrared and Visible Image Fusion Algorithms [J]. Computer Science, 2023, 50(2): 190-200.
[3] LI He, NIE Rencan, YANG Xiaofei, ZHANG Gucheng. Remote Sensing Image Fusion with Dual-branch Attention Network [J]. Computer Science, 2023, 50(11A): 230200072-7.
[4] WANG Bing, WU Hong-liang, NIU Xin-zheng. Robot Path Planning Based on Improved Potential Field Method [J]. Computer Science, 2022, 49(7): 196-203.
[5] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[6] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[7] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[8] YAN Min, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning [J]. Computer Science, 2022, 49(4): 215-220.
[9] WANG Ze-qing, JI Sheng-peng, LI Xin, ZHAO Zi-xuan, WANG Peng-xu, HAN Xiao-song. Novel College Entrance Filling Recommendation Algorithm Based on Score Line Prediction andMulti-feature Fusion [J]. Computer Science, 2022, 49(11A): 211100266-7.
[10] ZHANG Ying, NIE Ren-can, MA Chao-zhen, YU Shi-shuang. MRI and PET/SPECT Image Fusion Based on Subspace Feature Mutual Learning [J]. Computer Science, 2022, 49(11A): 211000171-6.
[11] GUAN Zheng, DENG Yang-lin, NIE Ren-can. Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion [J]. Computer Science, 2021, 48(9): 153-159.
[12] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[13] TIAN Song-wang, LIN Su-zhen, YANG Bo. Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator [J]. Computer Science, 2021, 48(8): 185-190.
[14] WEN He, LUO Pin-jie. Dynamic Face Recognition Based on Improved Pulse Coupled Neural Network [J]. Computer Science, 2021, 48(6A): 85-88.
[15] XU Ming-ze, WEI Ming-hui, DENG Shuang, CAI Wei. Application of Multi-model Ensemble Learning in Prediction of Mechanical Drilling Rate [J]. Computer Science, 2021, 48(6A): 619-622.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!