Computer Science ›› 2020, Vol. 47 ›› Issue (3): 124-129.doi: 10.11896/jsjkx.190100038

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Fusion of Infrared and Color Visible Images Based on Improved BEMD

ZHU Ying,XIA Yi-li,PEI Wen-jiang   

  1. (College of Information and Engineering, Southeast University, Nanjing 210096, China)
  • Received:2019-01-06 Online:2020-03-15 Published:2020-03-30
  • About author:ZHU Ying,born in 1994,postgraduate.Her main research interests include image processing. XIA Yi-li,born in 1984,professor.His research interests include statistical analysis,detection and estimation,linear and nonlinear adaptive filters,as well as their applications on communications,power systems and images.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61771124) and Perfection Young Scholars Program of Southeast University.

Abstract: Image fusion between the infrared and color visible images can enhance vision and improve the situation awareness.A direct use of the bidimensional empirical mode decomposition (BEMD) method for image fusion suffers from a high computation cost.Therefore,this paper proposed an improved BEMD for a fast and adaptive image fusion of infrared and color visible images.It is achieved by using order statistics filter and modified Gaussian filter to calculate the mean envelope directly,so as to accelerate the sifting process within the original BEMD.Firstly,the color visible image is transformed into IHS components.Secondly,the intensity component and the infrared image are decomposed into high frequency components and the low frequency components by means of the improved BEMD.Then,the adaptive local weighted fusion rule and the arithmetic mean rule are respectively applied to fuse the high frequency components and the low frequency components.Finally,the new intensity is transformed back into RGB.The proposed image fusion scheme is not only fast but also able to achieve the best fusion result,which merges edge details in the infrared image and the spectral information in the color visible image well.

Key words: Image fusion, BEMD, Order statistics filter, Gaussian filter, Adaptive local weighted fusion rule

CLC Number: 

  • TP391
[1]GHASSEMIAN H.A Review of Remote Sensing Image Fusion Methods[J].Information Fusion,2016,32(PA):75-89.
[2]MA J,MA Y,LI C.Infrared and visible image fusion methods and applications:A survey[J].Information Fusion,2018,45(1):153-178.
[3]HUANG N E,SHEN Z,LONG S R,et al.The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J].Proceedings Mathematical Physical & Engineering Sciences,1998,454(1971):903-995.
[4]NUNES J C,BOUAOUNE Y,DELECHELLE E,et al.Image analysis by bidimensional empirical mode decomposition[J].Image & Vision Computing,2003,21(12):1019-1026.
[5]HARIHARAN H,GRIBOK A,ABIDI M,et al.Image fusion and Enhancement via Empirical Mode Decomposition[J].Journal of Pattern Recognition Research,2006,1(1):16-32.
[6]LOONEY D,MANDIC D P.Multiscale Image Fusion Using Complex Extensions of EMD[J].IEEE Transactions on Signal Processing,2009,57(4):1626-1630.
[7]TANAKA T,MANDIC D P.Complex Empirical Mode Decomposition[J].IEEE Signal Processing Letters,2007,14(2):101-104.
[8]LIANG W,LIU Z.Region-based fusion of infrared and visible images using Bidimensional Empirical Mode Decomposition[C]∥International Conference on Educational & Information Technology.IEEE,2010:358-363.
[9]ZHANG X,CHEN Q,MEN T.Comparison of fusion methods for the infrared and color visible images[C]∥IEEE Internatio-nal Conference on Computer Science & Information Technology.IEEE,2009:421-424.
[10]ZANG Y,HUANG H,ZHANG L.Efficient Structure-Aware Image Smoothingby Local Extrema on Space-Filling Curve[J].IEEE Transactions on Visualization and Computer Graphics,2014,20(9):1253-1265.
[11]XINGMIN M,XIANWEI Z,FENGPING A.Bi-dimensional empirical mode decomposition (BEMD) and the stopping criterion based on the number and change of extreme points[J].Journal of Ambient Intelligence and Humanized Computing,2018,9(1):1-11.
[12]REZAEE M,TARAGHI OSGUEI A.Improving empirical mode decomposition for vibration signal analysis[J].Proceedings of the Institution of Mechanical Engineers,Part C:Journal of Mechanical Engineering Science,2016,231(12):2223-2234.
[13]LINDERHED A.2D empirical mode decompositions in the spirit of image compression[J].Proceedings of Spie Wavelet Indepen-dent Component Analysis Applications IX,2002,4738(7):1-8.
[14]DAMERVAL C,MEIGNEN S,VALéRIE Perrier.A fast algorithm for bidimensional EMD[J].IEEE Signal Processing Letters,2005,12(10):701-704.
[15]BHUIYAN S M A,ADHAMI R R,KHAN J F.Fast and Adaptive Bidimensional Empirical Mode Decomposition Using Order-Statistics Filter Based Envelope Estimation[J].Eurasip Journal on Advances in Signal Processing,2008,2008(1):1-18.
[16]BHUIYAN,ADHAMI,KHAN.A novel approach of fast and adaptive bidimensional empirical mode decomposition[C]∥IEEE International Conference on Acoustics.IEEE,2008:1313-1316.
[17]CHEN C Y,GUO S M,CHANG W S,et al.An improved bidimensional empirical mode decomposition:A mean approach for fast decomposition[J].Signal Processing,2014,98(5):344-358.
[18]AL-BADDAI S,AL-SUBARI K,TOMÉ,et al.A Green’s function-based Bi-dimensional Empirical Mode Decomposition[J].Information Sciences,2016(48):305-321.
[19]DILMAGHANI M S,DANESHVAR S,DOUSTY M.A new MRI and PET image fusion algorithm based on BEMD and IHS methods[C]∥Electrical Engineering.IEEE,2017:118-121.
[20]PARK C H,YANG L,SON Y W,et al.Fusion of the Infrared and Color Visible Images Using Bidimensional EMD[C]∥International Conference on Multimedia & Information Technology.IEEE,2008:257-260.
[21]BURT P J.Enhanced Image Capture Through Fusion[C]∥ICCV,1993:173-182.
[22]KHAN A,AGRAWAL P,SAINTHIYA H.Bidimentional empgirical mode decomposition based image fusion[C]∥Internatio-nal Conference on Recent Innovations in Signal processing and Embedded Systems.IEEE,2017:212-217.
[23]QU G,ZHANG D,YAN P.Information measure for perfor- mance of image fusion[J].Electronics Letters,2002,38(7):313-315.
[24]HONG R.Objective Image Fusion Performance Measure[J].Military Technical Courier,2000,56(2):181-193.
[25]WANG Z,BOVIK A C.A Universal Image Quality Index[J].IEEE Signal Processing Letters,2002,9(3):81-84.
[1] ZHU Zhen, HUANG Rui, ZANG Tie-gang, LU Shi-jun. Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion [J]. Computer Science, 2020, 47(8): 241-244.
[2] LI Chang-xing, LEI Liu, ZHANG Xiao-lu. Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN [J]. Computer Science, 2020, 47(10): 194-199.
[3] LI Xiao-yu,GAO Qing-wei,LU Yi-xiang,SUN Dong. Image Fusion Method Based on Image Energy Adjustment [J]. Computer Science, 2020, 47(1): 153-158.
[4] ZHANG Bing, XIE Cong-hua, LIU Zhe. Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information [J]. Computer Science, 2019, 46(9): 254-258.
[5] ANG Li-fang, SHI Chao-yu, LIN Su-zhen, QIN Pin-le, GAO Yuan. Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning [J]. Computer Science, 2019, 46(7): 238-245.
[6] LIU Bin,CHEN Wen-jiang,XIN Jia-nan. Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet [J]. Computer Science, 2019, 46(7): 268-273.
[7] XI Xin-xing, LUO Xiao-qing, ZHANG Zhan-cheng. Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model
[J]. Computer Science, 2019, 46(5): 254-259.
[8] WANG Ying, LIU Fan, CHEN Ze-hua. Image Fusion Algorithm Based on Improved Weighted Method and AdaptivePulse Coupled Neural Network in Shearlet Domain [J]. Computer Science, 2019, 46(4): 261-267.
[9] LI Kai, LUO Xiao-qing, ZHANG Zhan-cheng, WANG Jun. Image Fusion Using Quaternion Wavelet Transform and Copula Model [J]. Computer Science, 2019, 46(4): 293-299.
[10] MAO Yi-ping, YU Lei, GUAN Ze-jin. Multi-focus Image Fusion Based on Fractional Differential [J]. Computer Science, 2019, 46(11A): 315-319.
[11] LI Chang-xing, WU Jie. Infrared Image and Visible Image Fusion Based on FPDEs and CBF [J]. Computer Science, 2019, 46(1): 297-302.
[12] HOU Rui-chao,ZHOU Dong-ming,NIE Ren-can,LIU Dong,GUO Xiao-peng. Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN [J]. Computer Science, 2018, 45(6A): 162-166.
[13] YANG Yan-chun, LI Jiao, DANG Jian-wu and WANG Yang-ping. Multi-focus Image Fusion Based on Redundant Wavelet Transform and Guided Filtering [J]. Computer Science, 2018, 45(2): 301-305.
[14] YANG Li-su, WANG Lei, GUO Quan. Multi-focus Image Fusion Method Based on NSST and Adaptive PCNN [J]. Computer Science, 2018, 45(12): 217-222.
[15] YU Xiao-qing, CHEN Ren-wen, TANG Jie, XU Jin-ting. Edge Detection for Noisy Image Based on Wavelet Transform and New Mathematical Morphology [J]. Computer Science, 2018, 45(11A): 194-197.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .