Computer Science

Computer Science ›› 2020, Vol. 47 ›› Issue (3): 124-129.doi: 10.11896/jsjkx.190100038

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Fusion of Infrared and Color Visible Images Based on Improved BEMD

ZHU Ying,XIA Yi-li,PEI Wen-jiang   

  1. (College of Information and Engineering, Southeast University, Nanjing 210096, China)
  • Received:2019-01-06 Online:2020-03-15 Published:2020-03-30
  • About author:ZHU Ying,born in 1994,postgraduate.Her main research interests include image processing. XIA Yi-li,born in 1984,professor.His research interests include statistical analysis,detection and estimation,linear and nonlinear adaptive filters,as well as their applications on communications,power systems and images.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61771124) and Perfection Young Scholars Program of Southeast University.

PDF (PC)

988

Abstract: Image fusion between the infrared and color visible images can enhance vision and improve the situation awareness.A direct use of the bidimensional empirical mode decomposition (BEMD) method for image fusion suffers from a high computation cost.Therefore,this paper proposed an improved BEMD for a fast and adaptive image fusion of infrared and color visible images.It is achieved by using order statistics filter and modified Gaussian filter to calculate the mean envelope directly,so as to accelerate the sifting process within the original BEMD.Firstly,the color visible image is transformed into IHS components.Secondly,the intensity component and the infrared image are decomposed into high frequency components and the low frequency components by means of the improved BEMD.Then,the adaptive local weighted fusion rule and the arithmetic mean rule are respectively applied to fuse the high frequency components and the low frequency components.Finally,the new intensity is transformed back into RGB.The proposed image fusion scheme is not only fast but also able to achieve the best fusion result,which merges edge details in the infrared image and the spectral information in the color visible image well.

Key words: Adaptive local weighted fusion rule, BEMD, Gaussian filter, Image fusion, Order statistics filter

CLC Number: 

  • TP391
[1]GHASSEMIAN H.A Review of Remote Sensing Image Fusion Methods[J].Information Fusion,2016,32(PA):75-89.
[2]MA J,MA Y,LI C.Infrared and visible image fusion methods and applications:A survey[J].Information Fusion,2018,45(1):153-178.
[3]HUANG N E,SHEN Z,LONG S R,et al.The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J].Proceedings Mathematical Physical & Engineering Sciences,1998,454(1971):903-995.
[4]NUNES J C,BOUAOUNE Y,DELECHELLE E,et al.Image analysis by bidimensional empirical mode decomposition[J].Image & Vision Computing,2003,21(12):1019-1026.
[5]HARIHARAN H,GRIBOK A,ABIDI M,et al.Image fusion and Enhancement via Empirical Mode Decomposition[J].Journal of Pattern Recognition Research,2006,1(1):16-32.
[6]LOONEY D,MANDIC D P.Multiscale Image Fusion Using Complex Extensions of EMD[J].IEEE Transactions on Signal Processing,2009,57(4):1626-1630.
[7]TANAKA T,MANDIC D P.Complex Empirical Mode Decomposition[J].IEEE Signal Processing Letters,2007,14(2):101-104.
[8]LIANG W,LIU Z.Region-based fusion of infrared and visible images using Bidimensional Empirical Mode Decomposition[C]∥International Conference on Educational & Information Technology.IEEE,2010:358-363.
[9]ZHANG X,CHEN Q,MEN T.Comparison of fusion methods for the infrared and color visible images[C]∥IEEE Internatio-nal Conference on Computer Science & Information Technology.IEEE,2009:421-424.
[10]ZANG Y,HUANG H,ZHANG L.Efficient Structure-Aware Image Smoothingby Local Extrema on Space-Filling Curve[J].IEEE Transactions on Visualization and Computer Graphics,2014,20(9):1253-1265.
[11]XINGMIN M,XIANWEI Z,FENGPING A.Bi-dimensional empirical mode decomposition (BEMD) and the stopping criterion based on the number and change of extreme points[J].Journal of Ambient Intelligence and Humanized Computing,2018,9(1):1-11.
[12]REZAEE M,TARAGHI OSGUEI A.Improving empirical mode decomposition for vibration signal analysis[J].Proceedings of the Institution of Mechanical Engineers,Part C:Journal of Mechanical Engineering Science,2016,231(12):2223-2234.
[13]LINDERHED A.2D empirical mode decompositions in the spirit of image compression[J].Proceedings of Spie Wavelet Indepen-dent Component Analysis Applications IX,2002,4738(7):1-8.
[14]DAMERVAL C,MEIGNEN S,VALéRIE Perrier.A fast algorithm for bidimensional EMD[J].IEEE Signal Processing Letters,2005,12(10):701-704.
[15]BHUIYAN S M A,ADHAMI R R,KHAN J F.Fast and Adaptive Bidimensional Empirical Mode Decomposition Using Order-Statistics Filter Based Envelope Estimation[J].Eurasip Journal on Advances in Signal Processing,2008,2008(1):1-18.
[16]BHUIYAN,ADHAMI,KHAN.A novel approach of fast and adaptive bidimensional empirical mode decomposition[C]∥IEEE International Conference on Acoustics.IEEE,2008:1313-1316.
[17]CHEN C Y,GUO S M,CHANG W S,et al.An improved bidimensional empirical mode decomposition:A mean approach for fast decomposition[J].Signal Processing,2014,98(5):344-358.
[18]AL-BADDAI S,AL-SUBARI K,TOMÉ,et al.A Green’s function-based Bi-dimensional Empirical Mode Decomposition[J].Information Sciences,2016(48):305-321.
[19]DILMAGHANI M S,DANESHVAR S,DOUSTY M.A new MRI and PET image fusion algorithm based on BEMD and IHS methods[C]∥Electrical Engineering.IEEE,2017:118-121.
[20]PARK C H,YANG L,SON Y W,et al.Fusion of the Infrared and Color Visible Images Using Bidimensional EMD[C]∥International Conference on Multimedia & Information Technology.IEEE,2008:257-260.
[21]BURT P J.Enhanced Image Capture Through Fusion[C]∥ICCV,1993:173-182.
[22]KHAN A,AGRAWAL P,SAINTHIYA H.Bidimentional empgirical mode decomposition based image fusion[C]∥Internatio-nal Conference on Recent Innovations in Signal processing and Embedded Systems.IEEE,2017:212-217.
[23]QU G,ZHANG D,YAN P.Information measure for perfor- mance of image fusion[J].Electronics Letters,2002,38(7):313-315.
[24]HONG R.Objective Image Fusion Performance Measure[J].Military Technical Courier,2000,56(2):181-193.
[25]WANG Z,BOVIK A C.A Universal Image Quality Index[J].IEEE Signal Processing Letters,2002,9(3):81-84.
[1] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[2] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[3] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[4] YAN Min, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning [J]. Computer Science, 2022, 49(4): 215-220.
[5] GUAN Zheng, DENG Yang-lin, NIE Ren-can. Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion [J]. Computer Science, 2021, 48(9): 153-159.
[6] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[7] TIAN Song-wang, LIN Su-zhen, YANG Bo. Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator [J]. Computer Science, 2021, 48(8): 185-190.
[8] WANG Li-fang, WANG Rui-fang, LIN Su-zhen, QIN Pin-le, GAO Yuan, ZHANG Jin. Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J]. Computer Science, 2021, 48(2): 160-166.
[9] ZHU Zhen, HUANG Rui, ZANG Tie-gang, LU Shi-jun. Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion [J]. Computer Science, 2020, 47(8): 241-244.
[10] LI Chang-xing, LEI Liu, ZHANG Xiao-lu. Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN [J]. Computer Science, 2020, 47(10): 194-199.
[11] LI Xiao-yu,GAO Qing-wei,LU Yi-xiang,SUN Dong. Image Fusion Method Based on Image Energy Adjustment [J]. Computer Science, 2020, 47(1): 153-158.
[12] ZHANG Bing, XIE Cong-hua, LIU Zhe. Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information [J]. Computer Science, 2019, 46(9): 254-258.
[13] LIU Bin,CHEN Wen-jiang,XIN Jia-nan. Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet [J]. Computer Science, 2019, 46(7): 268-273.
[14] ANG Li-fang, SHI Chao-yu, LIN Su-zhen, QIN Pin-le, GAO Yuan. Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning [J]. Computer Science, 2019, 46(7): 238-245.
[15] XI Xin-xing, LUO Xiao-qing, ZHANG Zhan-cheng. Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model [J]. Computer Science, 2019, 46(5): 254-259.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.