Computer Science ›› 2020, Vol. 47 ›› Issue (1): 153-158.doi: 10.11896/jsjkx.181202437

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Image Fusion Method Based on Image Energy Adjustment

LI Xiao-yu,GAO Qing-wei,LU Yi-xiang,SUN Dong   

  1. (School of Electrical Engineering and Automation,Anhui University,Hefei 230601,China)
  • Received:2018-12-28 Published:2020-01-19
  • About author:LI Xiao-yu,born in 1993,postgraduate.His main research interests include machine learning;GAO Qing-wei,born in 1965,Ph.D,professor,Ph.D supervisor.His main research interests include digital signal processing and wavelet transform.
  • Supported by:
    This work was supported by Key Science Program of Anhui Education Department (KJ2018A0012) and Provincial Natural Science Foundation of Anhui (1608085MF125).

Abstract: Aiming at the problem that traditional image fusion algorithm can’t achieve good fusion effect on the image with large energy difference,this paper decomposed the high and low frequency signals of the two images by the combination of multi-scale transformation and sparse representation according to the energy division of the image.The sparse fusion rules of different energy image blocks are adjusted,and the consistency test is added in the high frequency part to further constrain the composite process of the MSD coefficients corresponding to the local spatial energy.Finally,the fused image is reconstructed by wavelet inverse transform.Infrared images,medical images and multi-focus images are used to verify its performance,the effects of sparse decomposition layer number and window step size on the fusion effect are analyzed,the optimal decomposition method under the framework is obtained,and then the fusion image with excellent subjective results and objective inclications are obtained.The experimental results show that the proposed algorithm can achieve better fusion effect when the image is obtained by any two types of sensors,and is not limited to the fusion of two images.It is superior to the traditional indicators such as SF,SSIM and EFQI of fusion algorithm and general multi-scale algorithm combined with sparse representation.

Key words: Multi-scale transformation, Sparse representation, Image fusion, Energy division, Consistency test

CLC Number: 

  • TP391
[1]PSJR C,SIDES S C,ANDERSON J A.Comparison of three different methods to merge multiresolution and multispectral data:Landsat TM and SPOT panchromatic[J].Photogrammetric Engineering & Remote Sensing,1991,57(3):265-303.
[2]RUI G,VOROBYOV S,HONG Z.Image FusionWith Cosparse Analysis Operator[J].IEEE Signal Processing Letters,2017,PP(99):1-1.
[3]RATTÁ G A,VEGA J,MURARI A,et al.Image fusion:Advances in the state of the art[J].Information Fusion,2007,8(2):114-118.
[4]WEN X.Image Fusion Based on Improved IHS Transform with Weighted Average[C]∥ International Conference on Computational & Information Sciences.Chengdu:IEEE,2011.
[5]HERVÉ A,WILLIAMS L J.Principal component analysis[J].Wiley Interdisciplinary Reviews Computational Statistics,2010,2(4):433-459.
[6]CUI Z,ZHANG G,WU J.Medical Image Fusion Based on Wavelet Transform and Independent Component Analysis[C]∥International Joint Conference on Artificial Intelligence.Hainan:IEEE,2009.
[7]YANG L,GUO B L,NI W.Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform[J].Neurocomputing,2008,72(1):203-211.
[8]BURT P J,ADELSON E H.The Laplacian Pyramid as a Com- pact Image Code[J].Readings in Computer Vision,1987,31(4):671-679.
[9]PETROVIC V S,XYDEAS C S.Gradient-Based Multiresolution Image Fusion[J].IEEE Transactions on Image Processing,2004,13(2):228-237.
[10]LI H,MANJUNATH B S,MITRA S K.Multi-Sensor Image Fusion using the Wavelet Transform[C]∥ Image Processing,Icip-94,IEEE International Conference.New York:IEEE,2002.
[11]LI S,KWOK J T,WANG Y.Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images[J].Information Fusion,2002,3(1):17-23.
[12]ZHANG Q,GUO B L.Multifocus image fusion using the nonsubsampled contourlet transform[J].Signal Processing,2009,89(7):1334-1346.
[13]XIAO D J,LI Q S,ZHOU C L.Research on adaptive image fusion method based on sparse representation[J].Computer Applications And Software,2014(3):203-206.
[14]YANG J,WRIGHT J,HUANG T S,et al.Image Super-Resolution Via Sparse Representation[J].IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[15]REXILINE D N D,ANUSMINA D J.Fusion and restoration of multifocus image using sparse representation[C]∥ International Conference on Advances in Engineering.Zouk-Mosbeh:IEEE,2012.
[16]REN Z,WANG S H,YUE L H.Source Optimization Selection Method for Multiple Heterogeneous Image Fusion[J].Computer Engineering,2009,35(23):229-231.
[17]LI S,YANG B,HU J.Performance comparison of different multi-resolution transforms for image fusion[J].Information Fusion,2011,12(2):74-84.
[18]PATI Y C,REZAIIFAR R,KRISHNAPRASAD P S.Orthogonal matching pursuit:recursive function approximation with applications to wavelet decomposition[C]∥ Conference on Signals,Systems & Computers.California:IEEE,2002.
[19]ZONG J,QIU T.Brain Image Fusion Based on Online Dictionary Learning and Pulse Coupled Neural Network[J].Chinese Journal of Biomedical Engineering,2015,5(3):223-227.
[20]GAO G,XU L,FENG D.Multi-focus image fusion based on non-subsampled shearlet transform[J].IET Image Processing,2013,7(6):633-639.
[21]SUN W.Application of shear wave transform in image fusion [D].Beijing:Beijing Jiaotong University,2015.
[22]XU Z Z,QU S R.A New Comprehensive Evaluation of Visible and Infrared Image Fusion[J].Infrared Technology,2011,33(10):568-573.
[23]HAN J J,LOFFELD O,HARTMANN K,et al.Multi image fusion based on compressive sensing[C]∥Proc of IEEE International Conference on Audio Language and Image Processing.2010:1463-1469.
[24]LIU Y,LIU S,WANG Z.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion,2015,24(1):147-164.
[25]CAO Y Q,CAO T,HUANG X S.Image fusion method combined CS and regional characteristics based on NSST[J].Computer Engineering and Applications,2018,54(20):190-196.
[26]CHEN J Q,HUANG D F.A Medical Image Fusion Improved Algorithm Based on NSCT and Adaptive PCNN[J].Journal of Changchun University of Science and Technology(Natural Science Edition),2015,38(3):152-155,159.
[1] TIAN Xu, CHANG Kan, HUANG Sheng, QIN Tuan-fa. Single Image Super-resolution Algorithm Using Residual Dictionary and Collaborative Representation [J]. Computer Science, 2020, 47(9): 135-141.
[2] ZHU Zhen, HUANG Rui, ZANG Tie-gang, LU Shi-jun. Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion [J]. Computer Science, 2020, 47(8): 241-244.
[3] CHENG Zhong-Jian, ZHOU Shuang-e and LI Kang. Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight [J]. Computer Science, 2020, 47(6A): 181-186.
[4] WU Qing-hong, GAO Xiao-dong. Face Recognition in Non-ideal Environment Based on Sparse Representation and Support Vector Machine [J]. Computer Science, 2020, 47(6): 121-125.
[5] ZHU Ying,XIA Yi-li,PEI Wen-jiang. Fusion of Infrared and Color Visible Images Based on Improved BEMD [J]. Computer Science, 2020, 47(3): 124-129.
[6] LI Chang-xing, LEI Liu, ZHANG Xiao-lu. Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN [J]. Computer Science, 2020, 47(10): 194-199.
[7] LI Gui-hui,LI Jin-jiang,FAN Hui. Image Denoising Algorithm Based on Adaptive Matching Pursuit [J]. Computer Science, 2020, 47(1): 176-185.
[8] ZHANG Bing, XIE Cong-hua, LIU Zhe. Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information [J]. Computer Science, 2019, 46(9): 254-258.
[9] SONG Xiao-xiang,GUO Yan,LI Ning,YU Dong-ping. Missing Data Prediction Algorithm Based on Sparse Bayesian Learning in Coevolving Time Series [J]. Computer Science, 2019, 46(7): 217-223.
[10] ANG Li-fang, SHI Chao-yu, LIN Su-zhen, QIN Pin-le, GAO Yuan. Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning [J]. Computer Science, 2019, 46(7): 238-245.
[11] LIU Bin,CHEN Wen-jiang,XIN Jia-nan. Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet [J]. Computer Science, 2019, 46(7): 268-273.
[12] ZHANG Fu-wang, YUAN Hui-juan. Image Super-resolution Reconstruction Algorithm with Adaptive Sparse Representationand Non-local Self-similarity [J]. Computer Science, 2019, 46(6A): 188-191.
[13] XI Xin-xing, LUO Xiao-qing, ZHANG Zhan-cheng. Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model
[J]. Computer Science, 2019, 46(5): 254-259.
[14] DU Xiu-li, ZUO Si-ming, QIU Shao-ming. Adaptive Dictionary Learning Algorithm Based on Image Gray Entropy [J]. Computer Science, 2019, 46(5): 266-271.
[15] RU Feng, XU Jin, CHANG Qi, KAN Dan-hui. High Order Statistics Structured Sparse Algorithm for Image Genetic Association Analysis [J]. Computer Science, 2019, 46(4): 66-72.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .