计算机科学 ›› 2019, Vol. 46 ›› Issue (4): 293-299.doi: 10.11896/j.issn.1002-137X.2019.04.046
李凯1,2, 罗晓清1,2, 张战成3, 王骏4
LI Kai1,2, LUO Xiao-qing1,2, ZHANG Zhan-cheng3, WANG Jun4
摘要: 四元数小波变换是一种既能够提供幅值又能够提供相位信息的新型多尺度变换工具。文中通过Copula模型捕获四元数小波变换系数的相关性,提出了一种基于四元数小波变换和Copula模型的图像融合算法。该算法首先对待融合图像进行四元数小波分解,接着通过构建Copula模型捕获高频子带幅度相位及低频对应相位之间的相关性,然后提取高频子带系数特征,即Copula联合概率密度的区域能量、相位梯度、系数能量和局部对比度。通过这些特征构建综合特征,并将该特征作为高频活动测度,采用综合特征取大的融合规则实现高频子带的融合;低频子带结合低频相位梯度和相位局部方差得到综合特征,将该特征作为低频活动测度,然后通过取大的融合规则实现低频子带的融合。最后使用逆四元数小波变换得到融合图像。实验结果表明,与传统融合算法相比,所提算法在主观和客观方面均取得了较佳的融合效果。
中图分类号:
[1]YONG Y,LEI W,HUANG S,et al.Remote Sensing Image Fusion Based on Adaptively Weighted Joint Detail Injection[J].IEEE Access,2018,6(99):6849-6864. [2]ZHAO W,LU H,DONG W.Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain[J].IEEE Tran-sactions on Multimedia,2018,20(4):866-879. [3]MISHRA A,MAHAPATRA S,BANERJEE S.Modified Frei-Chen Operator-Based Infrared and Visible Sensor Image Fusion for Real-Time Applications[J].IEEE Sensors Journal,2017,17(14):4639-4646. [4]ARDESHIR G A,NIKOLOV S.Image fusion:Advances in the state of the art[J].Information Fusion,2007,8(2):114-118. [5]MS E V,R V,K M,et al.A Novel Technique for Optimizing Panchromatic and Multispectral image fusion using Discrete Wavelet Transform[J].International Journal of Engineering & Techno-logy,2018,10(1):247-260. [6]CHOI H H,LEE J H,KIM S M,et al.Speckle noise reduction in ultrasound images using a discrete wavelet transform-based image fusion technique[J].Bio-medical Materials and Enginee-ring,2015,1(s1):1587-1597. [7]KANSAL I,KASANA S S.Fusion based Image De-fogging using Dual Tree Complex Wavelet Transform[J].International Journal of Wavelets Multiresolution & Information Processing,2018,16(6):276-291. [8]IQBAL N,SALEEM S,JEHAN W S,et al.Reduction of speckle noise in medical images using stationary wavelet transform and fuzzy logic[C]∥International Symposium on Recent Advances in Electrical Engineering.New York:IEEE,2017:1-6. [9]NENCINI F,GARZELLI A,BARONTI S,et al.Remote sensing image fusion using the curvelet transform[J].Information Fusion,2007,8(2):143-156. [10]CHAN W L,CHOI H,BARANIUK R G,et al.Quaternion Wavelets for Image Analysis and Processing[C]∥International Conference on Image Processing.New York:IEEE,2006:34-56. [11]SOULARD R,CARRÉ P.Quaternionic wavelets for texture classification[J].Pattern Recognition Letters,2011,32(13):1669-1678. [12]LIU Y,JIN J,WANG Q,et al.Phases measure of image sharpness based on quaternion wavelet[J].Pattern Recognition Letters,2013,34(9):1063-1070. [13]LIU Y P.Image processing and application based on quaternion wavelet transform[D].Harbin:HIT Harbin Institute of Technology,2014.(in Chinese) 刘义鹏.四元数小波域图像处理及其应用研究[D].哈尔滨:哈尔滨工业大学,2014. [14]CROUSE M S,BARANIUK R G.Contextual hidden Markov models for wavelet-domain signal processing ∥Asiloman Conference on .New York:IEEE,2006:67-90. [15]ZHANG X,LIU C,MEN T,et al.Infrared and visible image fusion using NSCT and GGD[J].Proceedings of SPIE- The International Society for Optical Engineering,2011,8009(4):80090-80094. [16]LIN Z X.An Improved Algorithm of Wavelet Image De-Noising Based on Threshold Function[J].Advanced Materials Research,2013,7(3):1674-1678. [17]SAKJI-NSIBI S,BENAZZA-BENYAHIA A.Copula-based statistical models for multicomponent image retrieval in thewavelet transform domain[C]∥IEEE International Conference on Image Processing.New York:IEEE,2010:253-256. [18]PORTILLA J,SIMONCELLI E P.Texture Modeling and Synthesis using Joint Statistics of Complex Wavelet Coecients[J].IEEE Workshop on Statistical & Computational Theories of Vision Fort Collins,1999,7(6):324-371. [19]KWITT R,MEERWALD P,UHL A.Efficient texture image retrieval using copulas in a Bayesian framework[J].IEEE Tran-sactions on Image Processing,2011,20(7):2063-2077. [20]SKLAR M.Fonctions de Répartition à N Dimensions Et Leurs Marges[J].Publ.inst.statist.univ.paris,1959,8(2):229-231. [21]PAPAEFTHYMIOU G,KUROWICKA D.Using Copulas for Modeling Stochastic Dependence in Power System Uncertainty Analysis[J].IEEE Transactions on Power Systems,2009,24(1):40-56. [22]LI C,LI J,FU B.Magnitude-Phase of Quaternion Wavelet Transform for Texture Representation Using Multilevel Copula[J].IEEE Signal Processing Letters,2013,20(8):799-802. [23]LIU Y,LIU S,WANG Z.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion,2015,24(1):147-164. [24]BHATNAGAR G,WU Q M J,LIU Z.Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain[J].IEEE Transactions on Multimedia,2013,15(5):1014-1024. [25]HAHN S,SNOPEK K.The unified theory of n-dimensional complex and hypercomplex analytic signals[J].Bulletin of the Polish Academy of Sciences Technical Sciences,2011,59(2):167-181. |
[1] | 赵明华, 周童童, 都双丽, 石争浩. 基于虚拟曝光方法的单幅逆光图像增强 Single Backlit Image Enhancement Based on Virtual Exposure Method 计算机科学, 2022, 49(6A): 384-389. https://doi.org/10.11896/jsjkx.210400243 |
[2] | 来腾飞, 周海洋, 余飞鸿. 视频流的实时景深延拓算法 Real-time Extend Depth of Field Algorithm for Video Processing 计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187 |
[3] | 高元浩, 罗晓清, 张战成. 基于特征分离的红外与可见光图像融合算法 Infrared and Visible Image Fusion Based on Feature Separation 计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148 |
[4] | 颜敏, 罗晓清, 张战成. 基于光传输模型学习的红外和可见光图像融合网络设计 Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning 计算机科学, 2022, 49(4): 215-220. https://doi.org/10.11896/jsjkx.210200174 |
[5] | 官铮, 邓扬琳, 聂仁灿. 光谱重建约束非负矩阵分解的高光谱与全色图像融合 Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion 计算机科学, 2021, 48(9): 153-159. https://doi.org/10.11896/jsjkx.200900054 |
[6] | 黄晓生, 徐静. 基于PCANet的非下采样剪切波域多聚焦图像融合 Multi-focus Image Fusion Method Based on PCANet in NSST Domain 计算机科学, 2021, 48(9): 181-186. https://doi.org/10.11896/jsjkx.200800064 |
[7] | 田嵩旺, 蔺素珍, 杨博. 基于多判别器的多波段图像自监督融合方法 Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator 计算机科学, 2021, 48(8): 185-190. https://doi.org/10.11896/jsjkx.200600132 |
[8] | 王丽芳, 王蕊芳, 蔺素珍, 秦品乐, 高媛, 张晋. 基于双残差超密集网络的多模态医学图像融合 Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks 计算机科学, 2021, 48(2): 160-166. https://doi.org/10.11896/jsjkx.200400095 |
[9] | 朱珍, 黄锐, 臧铁钢, 卢世军. 基于加权近红外图像融合的单幅图像除雾方法 Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion 计算机科学, 2020, 47(8): 241-244. https://doi.org/10.11896/jsjkx.200300068 |
[10] | 朱莹,夏亦犁,裴文江. 基于改进的BEMD的红外与可见光图像融合方法 Fusion of Infrared and Color Visible Images Based on Improved BEMD 计算机科学, 2020, 47(3): 124-129. https://doi.org/10.11896/jsjkx.190100038 |
[11] | 李昌兴, 雷柳, 张晓璐. 基于形态学图像增强和PCNN的脑部CT与MRI图像融合 Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN 计算机科学, 2020, 47(10): 194-199. https://doi.org/10.11896/jsjkx.190700185 |
[12] | 李笑宇,高清维,卢一相,孙冬. 一种根据图像能量调整的图像融合方法 Image Fusion Method Based on Image Energy Adjustment 计算机科学, 2020, 47(1): 153-158. https://doi.org/10.11896/jsjkx.181202437 |
[13] | 张冰, 谢从华, 刘哲. 基于显著稀疏表示和邻域信息的多聚焦图像融合 Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information 计算机科学, 2019, 46(9): 254-258. https://doi.org/10.11896/j.issn.1002-137X.2019.09.038 |
[14] | 王丽芳, 史超宇, 蔺素珍, 秦品乐, 高媛. 基于联合图像块聚类自适应字典学习的多模态医学图像融合 Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning 计算机科学, 2019, 46(7): 238-245. https://doi.org/10.11896/j.issn.1002-137X.2019.07.036 |
[15] | 刘斌,谌文江,辛迦楠. 基于四通道不可分加性小波的多聚焦图像融合 Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet 计算机科学, 2019, 46(7): 268-273. https://doi.org/10.11896/j.issn.1002-137X.2019.07.041 |
|