计算机科学 ›› 2019, Vol. 46 ›› Issue (9): 254-258.doi: 10.11896/j.issn.1002-137X.2019.09.038

• 图形图像与模式识别 • 上一篇    下一篇

基于显著稀疏表示和邻域信息的多聚焦图像融合

张冰1,2, 谢从华2, 刘哲3   

  1. (苏州大学计算机科学与技术学院 江苏 苏州215006)1;
    (常熟理工学院计算机科学与工程学院 江苏 苏州215500)2;
    (江苏大学计算机科学与通信工程学院 江苏 镇江212013)3
  • 收稿日期:2018-07-03 出版日期:2019-09-15 发布日期:2019-09-02
  • 通讯作者: 谢从华(1978-),男,博士,副教授,硕士生导师,主要研究方向为图像处理和机器学习,E-mail:Xiech@aliyun.com
  • 作者简介:张 冰(1993-),女,硕士生,主要研究方向为图像处理和机器学习;刘 哲(1982-),女,博士,副教授,硕士生导师,主要研究方向为图像处理。
  • 基金资助:
    国家自然科学基金(61772242,61572239,61402204)

Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information

ZHANG Bing1,2, XIE Cong-hua2, LIU Zhe3   

  1. (School of Computer Science and Technology,Soochow University,Suzhou,Jiangsu 215006,China)1;
    (School of Computer Science and Engineering,Changshu Institute of Technology,Suzhou,Jiangsu 215500,China)2;
    (School of Computer Science and Communication Engineering,Jiangsu University,Zhenjiang,Jiangsu 212013,China)3
  • Received:2018-07-03 Online:2019-09-15 Published:2019-09-02

摘要: 针对多聚焦图像融合算法中边缘模糊和重影的问题,文中提出了一种基于显著稀疏表示模型的多聚焦图像融合方法。首先,根据显著稀疏表示将图像分解为公共稀疏部分、独有稀疏部分和细节信息。其次,利用独有的特征和细节信息检测图像的聚焦区域。最后,利用图像的细节和邻域信息更精确地划分聚焦区域和散焦区域,将不同的源图像的聚焦区进行融合。大量实验结果表明,该方法对多聚焦图像实现了有效融合。与几种最先进的融合算法相比,该方法处理后的图像保留了更多的源图像信息和边缘信息,减少了未配准图像的重影,提高了图像的融合效果。

关键词: 多聚焦图像融合, 邻域信息, 失配图像, 稀疏表示

Abstract: This paper presented a novel fusion method based on latent sparse representation model for edge blurring and ghost in multi-focus image fusion.Firstly,it decomposes the image into public features,unique features and detail information by using latent sparse representation.Secondly,it combines unique features and detail information to determine the focused and defocused regions.Finally,it uses source information fused multi-focus images based on context information.A large number of experimental results show that the proposed method can effectively fuse multi-focus images.Compared with the most advanced methods,the images processed by this algorithm retain more information of the source image.At the same time,the ghost of the unregistered images is reduced,and the fusion effect of the image is greatly improved.

Key words: Multi-focus image fusion, Neighborhood information, Sparse representation, Unregistered images

中图分类号: 

  • TP391
[1]LI S,KANG X,HU J.Image fusion with guided filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.
[2]LIU Y,LIU S,WANG Z.Multi-focus image fusion with denseSIFT[J].Information Fusion,2015,23(C):139-155.
[3]CAO C H,ZHANG J H,LI L F.Multi-focus Image FusionBased on Twin--generation Differential Evolution and Adaptive Block Mechanism[J].Computer Science,2016,43(7):67-72,110(in Chinese)曹春红,张建华,李林峰.基于双子代差分演化和自适应分块机制的多聚焦图像融合算法[J].计算机科学,2016,43(7):67-72,110.
[4]YANG B,LI S.Multifocus image fusion and restoration withsparse representation[J].IEEE Transactions on Instrumentation & Measurement,2010,59(4):884-892.
[5]LIU Y,LIU S,WANG Z.A General Framework for Image Fusion Based on Multi-scale Transform and Sparse Representation[J].Information Fusion,2015,24:147-164.
[6] LIU Y,WANG Z.Simultaneous image fusion and denoising with adaptive sparse representation[J].IET Image Processing,2014,9(5):347-357.
[7]YAN C M,GUO B L,YI M.Multi-focus image fusion usingadaptive dictionary learning method[J].Journal of Image and Graphics,2012,17(9):1144-1149.(in Chinese)严春满,郭宝龙,易盟.自适应字典学习的多聚焦图像融合[J].中国图象图形学报,2012,17(9):1144-1149.
[8]YIN H,LI Y,CHAI Y,et al.A novel sparse-representation-based multi-focus image fusion approach[J].Neurocomputing,2016,216(C):216-229.
[9]GAO R,VOROBYOV A.Multi-Focus Image Fusion Via Coupled Sparse Representation and DictionaryLearning[OL].http://pdfs.semanticscholar.org/35a1/30a141b29b20866c8d85db8431489eddcb71.pdf.
[10]ZHANG Q,MARTIN D L.Robust Multi-Focus Image Fusion Using Multi-Task Sparse Representation and Spatial Context[J].IEEE Press,2016,25(5):2045-2058.
[11] DUARTE M F,SARVOTHAM S,BARON D,et al.Distributed compressed sensing of jointly sparse signals[C]//39th Asilomar Conference on Signals,Systems and Computers.2005:1537-1541.
[12]LIN Z,LIU R,SU Z.Linearized alternating direction method with adaptive penalty for low-rank representation[OL].http://www.cis.pku.edu.cn/faculty/vision/zlin/Publications/2011-NIPS-LADM.pdf.
[13]ZHANG Q,GUO B L.Multifocus image fusion using the nonsubsampled contourlet transform[J].Signal Processing,2009,89(7):1334-1346.
[14]HAGHIGHAT M B A,NAGHAGOLZADEH A,SEYEDARABI H.A non-reference image fusion metric based on mutual information of image features[J].Computers and Electrical Engineering,2011,37(5):744-756.
[15]XYDEAS C S,PETROVIC V.Objective image fusion perfor-mance measure[J].Military Technical Courier,2000,56(2):181-193.
[16]HAN Y,CAI Y,CAO Y,et al.A new image fusion performance metric based on visual information fidelity[J].Information Fusion,2013,14(2):127-135.
[1] 黄晓生, 徐静.
基于PCANet的非下采样剪切波域多聚焦图像融合
Multi-focus Image Fusion Method Based on PCANet in NSST Domain
计算机科学, 2021, 48(9): 181-186. https://doi.org/10.11896/jsjkx.200800064
[2] 李培冠, 於志勇, 黄昉菀.
基于稀疏表示的电力负荷数据补全
Power Load Data Completion Based on Sparse Representation
计算机科学, 2021, 48(2): 128-133. https://doi.org/10.11896/jsjkx.191200152
[3] 田旭, 常侃, 黄升, 覃团发.
基于残差字典及协作表达的单图像超分辨率算法
Single Image Super-resolution Algorithm Using Residual Dictionary and Collaborative Representation
计算机科学, 2020, 47(9): 135-141. https://doi.org/10.11896/jsjkx.190600146
[4] 程中建, 周双娥, 李康.
基于多尺度自适应权重的稀疏表示目标跟踪算法
Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight
计算机科学, 2020, 47(6A): 181-186. https://doi.org/10.11896/JsJkx.190500093
[5] 吴庆洪, 高晓东.
稀疏表示和支持向量机相融合的非理想环境人脸识别
Face Recognition in Non-ideal Environment Based on Sparse Representation and Support Vector Machine
计算机科学, 2020, 47(6): 121-125. https://doi.org/10.11896/jsjkx.190500058
[6] 李笑宇,高清维,卢一相,孙冬.
一种根据图像能量调整的图像融合方法
Image Fusion Method Based on Image Energy Adjustment
计算机科学, 2020, 47(1): 153-158. https://doi.org/10.11896/jsjkx.181202437
[7] 李桂会,李晋江,范辉.
自适应匹配追踪图像去噪算法
Image Denoising Algorithm Based on Adaptive Matching Pursuit
计算机科学, 2020, 47(1): 176-185. https://doi.org/10.11896/jsjkx.181202280
[8] 宋晓祥,郭艳,李宁,余东平.
基于稀疏贝叶斯学习的协同进化时间序列缺失数据预测算法
Missing Data Prediction Algorithm Based on Sparse Bayesian Learning in Coevolving Time Series
计算机科学, 2019, 46(7): 217-223. https://doi.org/10.11896/j.issn.1002-137X.2019.07.033
[9] 王丽芳, 史超宇, 蔺素珍, 秦品乐, 高媛.
基于联合图像块聚类自适应字典学习的多模态医学图像融合
Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning
计算机科学, 2019, 46(7): 238-245. https://doi.org/10.11896/j.issn.1002-137X.2019.07.036
[10] 张福旺, 苑会娟.
一种自适应稀疏表示和非局部自相似性的图像超分辨率重建算法
Image Super-resolution Reconstruction Algorithm with Adaptive Sparse Representationand Non-local Self-similarity
计算机科学, 2019, 46(6A): 188-191.
[11] 杜秀丽, 左思铭, 邱少明.
基于图像灰度熵的自适应字典学习算法
Adaptive Dictionary Learning Algorithm Based on Image Gray Entropy
计算机科学, 2019, 46(5): 266-271. https://doi.org/10.11896/j.issn.1002-137X.2019.05.041
[12] 茹锋, 徐锦, 常琪, 阚丹会.
一种用于影像遗传学关联分析的高阶统计量结构化稀疏算法
High Order Statistics Structured Sparse Algorithm for Image Genetic Association Analysis
计算机科学, 2019, 46(4): 66-72. https://doi.org/10.11896/j.issn.1002-137X.2019.04.010
[13] 王英, 刘帆, 陈泽华.
基于Shearlet域的改进加权法结合自适应PCNN的图像融合算法
Image Fusion Algorithm Based on Improved Weighted Method and AdaptivePulse Coupled Neural Network in Shearlet Domain
计算机科学, 2019, 46(4): 261-267. https://doi.org/10.11896/j.issn.1002-137X.2019.04.041
[14] 毛义坪, 余磊, 官泽瑾.
基于分数阶微分的多聚焦图像融合
Multi-focus Image Fusion Based on Fractional Differential
计算机科学, 2019, 46(11A): 315-319.
[15] 毛峡, 王岚, 李建军.
一种基于RGB-D特征融合的人体行为识别框架
Human Action Recognition Framework with RGB-D Features Fusion
计算机科学, 2018, 45(8): 22-27. https://doi.org/10.11896/j.issn.1002-137X.2018.08.005
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!