计算机科学 ›› 2019, Vol. 46 ›› Issue (7): 268-273.doi: 10.11896/j.issn.1002-137X.2019.07.041

• 图形图像与模式识别 • 上一篇    下一篇

基于四通道不可分加性小波的多聚焦图像融合

刘斌,谌文江,辛迦楠   

  1. (湖北大学计算机与信息工程学院 武汉430062)
  • 收稿日期:2018-06-06 出版日期:2019-07-15 发布日期:2019-07-15
  • 作者简介:刘 斌(1963-),男,博士,教授,博士生导师,主要研究方向为小波分析与应用、图像处理、模式识别、计算机视觉等,E-mail:liubin3318@163.com(通信作者);谌文江(1994-),女,硕士生,主要研究方向为小波分析与应用、图像增强、图像融合、模式识别等;辛迦楠(1992-),女, 硕士生,主要研究方向为小波分析与应用、图像增强、图像融合、模式识别等。
  • 基金资助:
    国家自然科学基金面上项目(61471160),湖北省自然科学基金重点项目(2012FFA053)资助

Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet

LIU Bin,CHEN Wen-jiang,XIN Jia-nan   

  1. (School of Computer and Information Engineering,Hubei University,Wuhan 430062,China)
  • Received:2018-06-06 Online:2019-07-15 Published:2019-07-15

摘要: 针对张量积小波不具有对称性,在图像融合中难以获得高空间分辨率图像的问题,文中利用伸缩矩阵为[2,0;0,2]的不可分小波的构造方法构造四通道6×6对称的不可分小波滤波器组,并把它应用于多聚焦图像的融合中。利用此类滤波器组中的低通滤波器对多聚焦图像进行加性小波分解,得到小波平面组,然后利用融合规则对分解后的小波平面进行融合。实验结果表明,该方法有较好的融合效果,融合结果图像具有较高的清晰度和空间分辨率,其融合性能优于拉普拉斯金字塔融合方法(基于LP的融合方法)、基于小波分解的融合方法(基于DWT的融合方法)和基于三通道不可分对称小波的融合方法(基于3-NSDWT的融合方法)。

关键词: 不可分小波, 多聚焦图像, 加性小波, 滤波器组, 图像融合

Abstract: In order to solve the problem that separable wavelets are not symmetry and cannot get high spatial resolution image,this paper constructed four channel 6 × 6 filter banks by using the method of non-separable wavelet transform which the dilation matrix is [2,0;0,2] and presented a multi-focus image fusion method based on this kind filter bank.The multifocus images are decomposed through additive wavelet mode by using the low-pass filter of the filter bank,and then the wavelet planes are obtained.Then the fusion rules are used to fuse the decomposed wavelet plane.The experiment results show that this method has better fusion effect in the high definition and spatial resolution.This fusion performance outperforms the Laplacian pyramid fusion method,the fusion method based on the wavelet decomposition and the fusion method based on three channel non-separable symmetric wavelet.

Key words: Additive wavelet, Filter bank, Image fusion, Multifocus image, Non-separable wavelet

中图分类号: 

  • TP391.4
[1]NANDAL A,BHASKAR V.Enhanced image fusion using directive contrast with higher-order approximation[J].IET Signal Processing,2018,12(4):383-393.
[2]FARID M S,MAHMOOD A,AL-MAADEED S A.Multi-focus Image Fusion Using Content Adaptive Blurring[J].Information Fusion,2018,45:96-112.
[3]XU H,WANG Y,WU Y,et al.Infrared and multi-type images fusion algorithm based on contrast pyramid transform[J].Infrared Physics & Technology,2016,78:133-146.
[4]MENG Q Q,YANG G,TONG T,et al.Fusion algorithm of multifocus images based on wavelet transform[J].Remote Sen-sing for Land & Resources,2014,26(2):38-42.(in Chinese)
孟强强,杨桄,童涛,等.基于小波变换的多聚焦图像融合算法[J].国土资源遥感,2014,26(2):38-42.
[5]JIANG Q,JIN X,LEE S J,et al.A Novel Multi-focus Image Fusion Method Based on Stationary Wavelet Transform and Local Features of Fuzzy Sets[J].IEEE Access,2017,5:1.
[6]YANG D,SHAOHAI H U,LIU S,et al.Multi-focus image fusion based on block matching in 3D transform domain[J].Journal of Systems Engineering and Electronics,2018,29(2):415-428.
[7]ZHANG Y,BAI X,WANG T.Boundary finding based multi-focus image fusion through multi-scale morphological focus-mea-sure[J].Information Fusion,2017,35:81-101.
[8]YANG Y,TONG S,HUANG S,et al.A Hybrid Method for Multi-Focus Image Fusion Based on Fast Discrete Curvelet Transform[J].IEEE Access,2017,5(99):14898-14913.
[9]LI S,YANG B.Multifocus image fusion by combining curvelet and wavelet transform [J].Pattern Recognition Letters,2008,29(9):1295-1301.
[10]LI H,CHAI Y,LI Z.Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection[J].Optik-International Journal for Light and Electron Optics,2013,124(1):40-51.
[11]CHAI Y,LI H F,GUO M Y.Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain[J].Optics Communications,2011,284(5):1146-1158.
[12]LIU B,FU Z W.Multi-focus image fusion based on four-channel non-separable lifting wavelet[J].Systems Engineering & Electronics,2018,40(2):463-471.(in Chinese)
刘斌,付忠旺.基于四通道不可分提升小波的多聚焦图像融合[J].系统工程与电子技术,2018,40(2):463-471.
[13]LIU B,LIU W J,MA J L.Multi-focus image fusion based on three channel nonseparable symmetrical wavelets[J].Chinese Journal of Scientific Instrument,2012,33(5):1110-1116.(in Chinese)
刘斌,刘维杰,马嘉利.基于三通道不可分对称小波的多聚焦图像融合[J].仪器仪表学报,2012,33(5):1110-1116.
[14]XU Y M.Study on Multi-Focus Image Fusion Based on Multi-Scale Transform[D].Xuzhou:China University of Mining and Technology,2012.(in Chinese)
徐月美.多尺度变换的多聚焦图像融合算法研究[D].徐州:中国矿业大学,2012.
[15]NUNEZ J,OTAZU X,FORS O,et al.Multiresolution-based image fusion with additive wavelet decomposition[J].IEEE Transactions on Geoscience & Remote Sensing,1999,37(3):1204-1211.
[16]LIU B,PENG J X.Image fusion method based on nonseparable wavelets[J].Machine Vision & Applications,2005,16(3):189-196.
[17]LIU B,PENG J X.Image Fusion Method Based on Short Support Symmetric Non-separable Wavelet[J].International Journal of Wavelets Multiresolution & Information Processing,2004,2(1):87-98.
[18]LIU B,PENG J X.Fusion Method of MultiSpectral Image and Panchromatic Image Based on Four Channels NonSeparable Additive Wavelets:Fusion Method of MultiSpectral Image and Panchromatic Image Based on Four Channels NonSeparable Additive Wavelets[J].Chinese Journal of Computers,2009,32(2):350-356.(in Chinese)
刘斌,彭嘉雄.基于四通道不可分加性小波的多光谱图像融合[J].计算机学报,2009,32(2):350-356.
[19]CHEN Q,MICCHELLI C A,PENG S,et al.Multivariate Filter Banks Having Matrix Factorizations[J].Siam Journal on Matrix Analysis & Applications,2004,25(2):517-531.
[20]LI S,YANG B,HU J.Performance comparison of different multi-resolution transforms for image fusion [J].Information Fusion,2011,12(2):74-84.
[21]CAI Z S,CHEN M S.Study on Multi-Focus Image Fusion Method Based on Wavelet Transfrom[J].Laser & Optoelectronics Progress,2015,52(9):117-121.(in Chinese)
蔡植善,陈木生.基于小波变换的多聚焦图像融合方法研究[J].激光与光电子学进展,2015,52(9):117-121.
[22]LUO H B.Based on the digital image fusion research of laplacian pyramid[J].Automation & Instrumentation,2014(3):27-28.(in Chinese)
罗鸿斌.基于拉普拉高斯金字塔的数字图像融合研究[J].自动化与仪器仪表,2014(3):27-28.
[1] 来腾飞, 周海洋, 余飞鸿.
视频流的实时景深延拓算法
Real-time Extend Depth of Field Algorithm for Video Processing
计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187
[2] 赵明华, 周童童, 都双丽, 石争浩.
基于虚拟曝光方法的单幅逆光图像增强
Single Backlit Image Enhancement Based on Virtual Exposure Method
计算机科学, 2022, 49(6A): 384-389. https://doi.org/10.11896/jsjkx.210400243
[3] 高元浩, 罗晓清, 张战成.
基于特征分离的红外与可见光图像融合算法
Infrared and Visible Image Fusion Based on Feature Separation
计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[4] 颜敏, 罗晓清, 张战成.
基于光传输模型学习的红外和可见光图像融合网络设计
Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning
计算机科学, 2022, 49(4): 215-220. https://doi.org/10.11896/jsjkx.210200174
[5] 官铮, 邓扬琳, 聂仁灿.
光谱重建约束非负矩阵分解的高光谱与全色图像融合
Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion
计算机科学, 2021, 48(9): 153-159. https://doi.org/10.11896/jsjkx.200900054
[6] 黄晓生, 徐静.
基于PCANet的非下采样剪切波域多聚焦图像融合
Multi-focus Image Fusion Method Based on PCANet in NSST Domain
计算机科学, 2021, 48(9): 181-186. https://doi.org/10.11896/jsjkx.200800064
[7] 田嵩旺, 蔺素珍, 杨博.
基于多判别器的多波段图像自监督融合方法
Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator
计算机科学, 2021, 48(8): 185-190. https://doi.org/10.11896/jsjkx.200600132
[8] 王丽芳, 王蕊芳, 蔺素珍, 秦品乐, 高媛, 张晋.
基于双残差超密集网络的多模态医学图像融合
Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks
计算机科学, 2021, 48(2): 160-166. https://doi.org/10.11896/jsjkx.200400095
[9] 朱珍, 黄锐, 臧铁钢, 卢世军.
基于加权近红外图像融合的单幅图像除雾方法
Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion
计算机科学, 2020, 47(8): 241-244. https://doi.org/10.11896/jsjkx.200300068
[10] 朱莹,夏亦犁,裴文江.
基于改进的BEMD的红外与可见光图像融合方法
Fusion of Infrared and Color Visible Images Based on Improved BEMD
计算机科学, 2020, 47(3): 124-129. https://doi.org/10.11896/jsjkx.190100038
[11] 李昌兴, 雷柳, 张晓璐.
基于形态学图像增强和PCNN的脑部CT与MRI图像融合
Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN
计算机科学, 2020, 47(10): 194-199. https://doi.org/10.11896/jsjkx.190700185
[12] 李笑宇,高清维,卢一相,孙冬.
一种根据图像能量调整的图像融合方法
Image Fusion Method Based on Image Energy Adjustment
计算机科学, 2020, 47(1): 153-158. https://doi.org/10.11896/jsjkx.181202437
[13] 张冰, 谢从华, 刘哲.
基于显著稀疏表示和邻域信息的多聚焦图像融合
Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information
计算机科学, 2019, 46(9): 254-258. https://doi.org/10.11896/j.issn.1002-137X.2019.09.038
[14] 王丽芳, 史超宇, 蔺素珍, 秦品乐, 高媛.
基于联合图像块聚类自适应字典学习的多模态医学图像融合
Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning
计算机科学, 2019, 46(7): 238-245. https://doi.org/10.11896/j.issn.1002-137X.2019.07.036
[15] 席新星, 罗晓清, 张战成.
基于3-D剪切波和广义高斯模型的多模态医学序列图像融合
Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model
计算机科学, 2019, 46(5): 254-259. https://doi.org/10.11896/j.issn.1002-137X.2019.05.039
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!