Computer Science ›› 2019, Vol. 46 ›› Issue (1): 297-302.doi: 10.11896/j.issn.1002-137X.2019.01.046

• Graphics ,Image & Pattern Recognition • Previous Articles     Next Articles

Infrared Image and Visible Image Fusion Based on FPDEs and CBF

LI Chang-xing1, WU Jie2   

  1. (School of Sciences,Xi’an University of Posts & Telecommunications,Xi’an 710121,China)1
    (School of Communication and Information Engineering,Xi’an University of Posts & Telecommunications,Xi’an 710121,China)2
  • Received:2017-12-08 Online:2019-01-15 Published:2019-02-25

Abstract: Considering the problems of low contrast,blocky effects,artifacts and distortion of the edge region in traditional fused images,this paper proposed an infrared image and visible image fusion method based on fourth order partial differential equations(FPDEs) and cross bilateral filter(CBF).Firstly,the FPDEs and CBF are respectively used to obtain the approximation layers and detail layers from the source image.Secondly,the approximate layers obtained by multi-scale decompositions may contain amount of residual low-frequence information which will result in large contrast of the overall visual of the fused image,so a fusion method based on visual saliency map(VSM) is used to fuse the approximate layers.Thirdly,an improved Karhunen-Loeve transform is applied into the detail layer to obtain the optimal weights for fusion.Finally,a fused image is generated from the linear combination of final approximate layers and detail layers.Experimental results show that the standard deviation of the fused image obtained by the proposed method increases about 43.3% than PCA based method and cross bilateral filter based method,and the average gradient and spatial frequency increase about 9.46% and 19.79% respectively on average compared with GFF and VSM_WLS algorithms.

Key words: Image fusion, Fourth order partial differential equations, Cross bilateral filter, Visual saliency map, Karhunen-Loeve transform

CLC Number: 

  • TP391
[1]DU L.Infrared and visible image fusion based on random projection and sparse representation[J].International Journal of Remote Sensing,2014,35(5):1640-1652.<br /> [2]GHASSEMIAN H.A review of remote sensing image fusion methods[J].Information Fusion,2016,32(PA):75-89.<br /> [3]ZHOU Y R,GENG A H,ZHANG Q,et al.Fusion of infrared and visible images based on compressive sensing[J].Optics and Precision Engineering,2015,23(3):855-863.(in Chinese)<br /> 周渝人,耿爱辉,张强,等.基于压缩感知的红外与可见光图像融合[J].光学精密工程,2015,23(3):855-863.<br /> [4]LI C X,WANG P P,SHEN C.The fusion of medical images based on two transform domains[J].Journal of Xi’an University of Posts and Telecommunications,2013,18(4):37-40.(in Chinese)<br /> 李昌兴,王平平,申超.两种变换域相结合的医学图像融合[J].西安邮电大学学报,2013,18(4):37-40.<br /> [5]KUMAR B K S.Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform[J].Signal Image & Video Processing,2013,7(6):1125-1143.<br /> [6]KUMAR B K S.Image fusion based on pixel significance using cross bilateral filter[J].Signal Image & Video Processing,2015,9(5):1193-1204.<br /> [7]LI S,KANG X,HU J.Image fusion with guided filtering[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2013,22(7):2864.<br /> [8]BAVIRISETTI,PRASAD D,DHULI R-V.Fusion of infrared and visible sensor images based on anisotropic diffusion and Karhunen-Loeve transform[J].IEEE Sensors Journal,2016,16(1):203-209.<br /> [9]YOU Y L,KAVEH M.Fourth-order partial differential equations for noise removal[J].IEEE Transactions on Image Processing,2000,9(10):1723-1730.<br /> [10]ZHAI Y,SHAH M.Visual attention detection in video sequences using spatiotemporal cues[C]//ACM International Conference on Multimedia.ACM,2006:815-824.<br /> [11]GONZALEZ R C.Digital Image Processing[M].Chandigarh,India:Pearson Education India,2009.<br /> [12]THEOHARATOS C,TSAGARIS V,FRAGOULIS N,et al.Hyperspectral image fusion using 2-D principal component ana-lysis[C]//International Conference on Space Technology.IEEE,Athens,2011:1-4.<br /> [13]VIJAYARAJAN R,MUTTAN S.Discrete wavelet transform based principal component averaging fusion for medical images[J].AEUE-International Journal of Electronics and Communications,2015,69(6):896-902.<br /> [14]MA J,ZHOU Z,WANG B,et al.Infrared and visible image fusion based on visual saliency map and weighted least square optimization[J].Infrared Physics & Technology,2017,82:8-17.<br /> [15]BAVIRISETTI D P,XIAO G,LIU G.Multi-sensor image fusion based on fourth order partial differential equations[C]//Proceedings of IEEE 2017 20th International Conference on Information Fusion (Fusion).Xi’an,2017:1-9.<br /> [16]ÅSTRÖM F,BARAVDISH G,FELSBERG M.On Tensor-Based PDEs and Their Corresponding Variational Formulations with Application to Color Image Denoising[M]//Computer Vision-ECCV 2012.Springer Berlin Heidelberg,2012:215-228.<br /> [17]PERONA P,MALIK J.Scale-space and edge detection using anisotropic diffusion[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,12(7):629-639.<br /> [18]TOMASI C,MANDUCHI R.Bilateral filtering for gray and color images[C]//Proceedings of the International Conference on Computer Vision.1998:839-846.<br /> [19]ZHANG M,GUNTURK B K.Multiresolution bilateral filtering for image denoising[J].IEEE Transactions on Image Proces-sing,2008,17(12):2324-2333.<br /> [20]PETSCHNIGG G,AGRAWALA M,HOPPE H,et al.Digital photography with flash and no-flash image pairs[J].ACM Transactions on Graphics,2004,23(3):664-672.<br /> [21]CHENG M M,MITRA N J,HUANG X,et al.Global Contrast Based Salient Region Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,37(3):569.<br /> [22]BAI X,CHEN X,ZHOU F,et al.Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest[J].Infrared Physics & Technology,2013,60(9):81-93.<br /> [23]HAGHIGHAT M B A,AGHAGOLZADEH A,SEYEDARABI H.A non-reference image fusion metric based on mutual information of image features[J].Computers & Electrical Enginee-ring,2011,37(5):744-756.
[1] ZHANG Bing, XIE Cong-hua, LIU Zhe. Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information [J]. Computer Science, 2019, 46(9): 254-258.
[2] ANG Li-fang, SHI Chao-yu, LIN Su-zhen, QIN Pin-le, GAO Yuan. Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning [J]. Computer Science, 2019, 46(7): 238-245.
[3] LIU Bin,CHEN Wen-jiang,XIN Jia-nan. Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet [J]. Computer Science, 2019, 46(7): 268-273.
[4] XI Xin-xing, LUO Xiao-qing, ZHANG Zhan-cheng. Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model
[J]. Computer Science, 2019, 46(5): 254-259.
[5] WANG Ying, LIU Fan, CHEN Ze-hua. Image Fusion Algorithm Based on Improved Weighted Method and AdaptivePulse Coupled Neural Network in Shearlet Domain [J]. Computer Science, 2019, 46(4): 261-267.
[6] LI Kai, LUO Xiao-qing, ZHANG Zhan-cheng, WANG Jun. Image Fusion Using Quaternion Wavelet Transform and Copula Model [J]. Computer Science, 2019, 46(4): 293-299.
[7] HOU Rui-chao,ZHOU Dong-ming,NIE Ren-can,LIU Dong,GUO Xiao-peng. Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN [J]. Computer Science, 2018, 45(6A): 162-166.
[8] YANG Yan-chun, LI Jiao, DANG Jian-wu and WANG Yang-ping. Multi-focus Image Fusion Based on Redundant Wavelet Transform and Guided Filtering [J]. Computer Science, 2018, 45(2): 301-305.
[9] YANG Li-su, WANG Lei, GUO Quan. Multi-focus Image Fusion Method Based on NSST and Adaptive PCNN [J]. Computer Science, 2018, 45(12): 217-222,250.
[10] YU Xiao-qing, CHEN Ren-wen, TANG Jie, XU Jin-ting. Edge Detection for Noisy Image Based on Wavelet Transform and New Mathematical Morphology [J]. Computer Science, 2018, 45(11A): 194-197.
[11] XIE Qiu-ying, YI Ben-shun, KE Zu-fu and LI Wei-zhong. Multi-focus Image Fusion Based on SML and PCNN in NSCT Domain [J]. Computer Science, 2017, 44(6): 266-269, 282.
[12] ZHAO Jie, WEN Xin, LIU Suai-qi and ZHANG Yu. Multi-focus Image Fusion Using Adaptive Region and SCM Based on NSST Domain [J]. Computer Science, 2017, 44(3): 318-322.
[13] GENG Yan-ping, GUO Xiao-ying, WANG Hua-xia, CHEN Lei and LI Xue-mei. MR Brain Image Segmentation Method Based on Wavelet Transform Image Fusion Algorithm and Improved FCM Clustering [J]. Computer Science, 2017, 44(12): 260-265.
[14] CAO Yi-qin, HE Ya-fei and HUANG Xiao-sheng. Multi-focus Image Fusion Algorithm Based on Compressed Sensing and Regional Characteristics [J]. Computer Science, 2017, 44(1): 295-299.
[15] WANG Quan, NIE Ren-can, JIN Xin, ZHOU Dong-ming, HE Kang-jian and YU Jie-fu. Image Fusion Algorithm Using LP Transformation and PCNN-SML [J]. Computer Science, 2016, 43(Z6): 122-124.
Full text



[1] . [J]. Computer Science, 2018, 1(1): 1 .
[2] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[3] XIA Qing-xun and ZHUANG Yi. Remote Attestation Mechanism Based on Locality Principle[J]. Computer Science, 2018, 45(4): 148 -151, 162 .
[4] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[5] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[6] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[7] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[8] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[9] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[10] ZHONG Fei and YANG Bin. License Plate Detection Based on Principal Component Analysis Network[J]. Computer Science, 2018, 45(3): 268 -273 .