Computer Science ›› 2020, Vol. 47 ›› Issue (1): 153-158.doi: 10.11896/jsjkx.181202437

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Image Fusion Method Based on Image Energy Adjustment

LI Xiao-yu,GAO Qing-wei,LU Yi-xiang,SUN Dong   

  1. (School of Electrical Engineering and Automation,Anhui University,Hefei 230601,China)
  • Received:2018-12-28 Published:2020-01-19
  • About author:LI Xiao-yu,born in 1993,postgraduate.His main research interests include machine learning;GAO Qing-wei,born in 1965,Ph.D,professor,Ph.D supervisor.His main research interests include digital signal processing and wavelet transform.
  • Supported by:
    This work was supported by Key Science Program of Anhui Education Department (KJ2018A0012) and Provincial Natural Science Foundation of Anhui (1608085MF125).

Abstract: Aiming at the problem that traditional image fusion algorithm can’t achieve good fusion effect on the image with large energy difference,this paper decomposed the high and low frequency signals of the two images by the combination of multi-scale transformation and sparse representation according to the energy division of the image.The sparse fusion rules of different energy image blocks are adjusted,and the consistency test is added in the high frequency part to further constrain the composite process of the MSD coefficients corresponding to the local spatial energy.Finally,the fused image is reconstructed by wavelet inverse transform.Infrared images,medical images and multi-focus images are used to verify its performance,the effects of sparse decomposition layer number and window step size on the fusion effect are analyzed,the optimal decomposition method under the framework is obtained,and then the fusion image with excellent subjective results and objective inclications are obtained.The experimental results show that the proposed algorithm can achieve better fusion effect when the image is obtained by any two types of sensors,and is not limited to the fusion of two images.It is superior to the traditional indicators such as SF,SSIM and EFQI of fusion algorithm and general multi-scale algorithm combined with sparse representation.

Key words: Consistency test, Energy division, Image fusion, Multi-scale transformation, Sparse representation

CLC Number: 

  • TP391
[1]PSJR C,SIDES S C,ANDERSON J A.Comparison of three different methods to merge multiresolution and multispectral data:Landsat TM and SPOT panchromatic[J].Photogrammetric Engineering & Remote Sensing,1991,57(3):265-303.
[2]RUI G,VOROBYOV S,HONG Z.Image FusionWith Cosparse Analysis Operator[J].IEEE Signal Processing Letters,2017,PP(99):1-1.
[3]RATTÁ G A,VEGA J,MURARI A,et al.Image fusion:Advances in the state of the art[J].Information Fusion,2007,8(2):114-118.
[4]WEN X.Image Fusion Based on Improved IHS Transform with Weighted Average[C]∥ International Conference on Computational & Information Sciences.Chengdu:IEEE,2011.
[5]HERVÉ A,WILLIAMS L J.Principal component analysis[J].Wiley Interdisciplinary Reviews Computational Statistics,2010,2(4):433-459.
[6]CUI Z,ZHANG G,WU J.Medical Image Fusion Based on Wavelet Transform and Independent Component Analysis[C]∥International Joint Conference on Artificial Intelligence.Hainan:IEEE,2009.
[7]YANG L,GUO B L,NI W.Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform[J].Neurocomputing,2008,72(1):203-211.
[8]BURT P J,ADELSON E H.The Laplacian Pyramid as a Com- pact Image Code[J].Readings in Computer Vision,1987,31(4):671-679.
[9]PETROVIC V S,XYDEAS C S.Gradient-Based Multiresolution Image Fusion[J].IEEE Transactions on Image Processing,2004,13(2):228-237.
[10]LI H,MANJUNATH B S,MITRA S K.Multi-Sensor Image Fusion using the Wavelet Transform[C]∥ Image Processing,Icip-94,IEEE International Conference.New York:IEEE,2002.
[11]LI S,KWOK J T,WANG Y.Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images[J].Information Fusion,2002,3(1):17-23.
[12]ZHANG Q,GUO B L.Multifocus image fusion using the nonsubsampled contourlet transform[J].Signal Processing,2009,89(7):1334-1346.
[13]XIAO D J,LI Q S,ZHOU C L.Research on adaptive image fusion method based on sparse representation[J].Computer Applications And Software,2014(3):203-206.
[14]YANG J,WRIGHT J,HUANG T S,et al.Image Super-Resolution Via Sparse Representation[J].IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[15]REXILINE D N D,ANUSMINA D J.Fusion and restoration of multifocus image using sparse representation[C]∥ International Conference on Advances in Engineering.Zouk-Mosbeh:IEEE,2012.
[16]REN Z,WANG S H,YUE L H.Source Optimization Selection Method for Multiple Heterogeneous Image Fusion[J].Computer Engineering,2009,35(23):229-231.
[17]LI S,YANG B,HU J.Performance comparison of different multi-resolution transforms for image fusion[J].Information Fusion,2011,12(2):74-84.
[18]PATI Y C,REZAIIFAR R,KRISHNAPRASAD P S.Orthogonal matching pursuit:recursive function approximation with applications to wavelet decomposition[C]∥ Conference on Signals,Systems & Computers.California:IEEE,2002.
[19]ZONG J,QIU T.Brain Image Fusion Based on Online Dictionary Learning and Pulse Coupled Neural Network[J].Chinese Journal of Biomedical Engineering,2015,5(3):223-227.
[20]GAO G,XU L,FENG D.Multi-focus image fusion based on non-subsampled shearlet transform[J].IET Image Processing,2013,7(6):633-639.
[21]SUN W.Application of shear wave transform in image fusion [D].Beijing:Beijing Jiaotong University,2015.
[22]XU Z Z,QU S R.A New Comprehensive Evaluation of Visible and Infrared Image Fusion[J].Infrared Technology,2011,33(10):568-573.
[23]HAN J J,LOFFELD O,HARTMANN K,et al.Multi image fusion based on compressive sensing[C]∥Proc of IEEE International Conference on Audio Language and Image Processing.2010:1463-1469.
[24]LIU Y,LIU S,WANG Z.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion,2015,24(1):147-164.
[25]CAO Y Q,CAO T,HUANG X S.Image fusion method combined CS and regional characteristics based on NSST[J].Computer Engineering and Applications,2018,54(20):190-196.
[26]CHEN J Q,HUANG D F.A Medical Image Fusion Improved Algorithm Based on NSCT and Adaptive PCNN[J].Journal of Changchun University of Science and Technology(Natural Science Edition),2015,38(3):152-155,159.
[1] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[2] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[3] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[4] YAN Min, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning [J]. Computer Science, 2022, 49(4): 215-220.
[5] GUAN Zheng, DENG Yang-lin, NIE Ren-can. Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion [J]. Computer Science, 2021, 48(9): 153-159.
[6] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[7] TIAN Song-wang, LIN Su-zhen, YANG Bo. Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator [J]. Computer Science, 2021, 48(8): 185-190.
[8] LI Pei-guan, YU Zhi-yong, HUANG Fang-wan. Power Load Data Completion Based on Sparse Representation [J]. Computer Science, 2021, 48(2): 128-133.
[9] WANG Li-fang, WANG Rui-fang, LIN Su-zhen, QIN Pin-le, GAO Yuan, ZHANG Jin. Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J]. Computer Science, 2021, 48(2): 160-166.
[10] TIAN Xu, CHANG Kan, HUANG Sheng, QIN Tuan-fa. Single Image Super-resolution Algorithm Using Residual Dictionary and Collaborative Representation [J]. Computer Science, 2020, 47(9): 135-141.
[11] ZHU Zhen, HUANG Rui, ZANG Tie-gang, LU Shi-jun. Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion [J]. Computer Science, 2020, 47(8): 241-244.
[12] CHENG Zhong-Jian, ZHOU Shuang-e and LI Kang. Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight [J]. Computer Science, 2020, 47(6A): 181-186.
[13] WU Qing-hong, GAO Xiao-dong. Face Recognition in Non-ideal Environment Based on Sparse Representation and Support Vector Machine [J]. Computer Science, 2020, 47(6): 121-125.
[14] ZHU Ying,XIA Yi-li,PEI Wen-jiang. Fusion of Infrared and Color Visible Images Based on Improved BEMD [J]. Computer Science, 2020, 47(3): 124-129.
[15] LI Chang-xing, LEI Liu, ZHANG Xiao-lu. Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN [J]. Computer Science, 2020, 47(10): 194-199.
Full text



No Suggested Reading articles found!