计算机科学 ›› 2020, Vol. 47 ›› Issue (4): 131-135.doi: 10.11896/jsjkx.190300149

• 计算机图形学&多媒体 • 上一篇    下一篇

基于结构相关性的自适应图像修复

周先春1,2, 徐燕1   

  1. 1 南京信息工程大学电子与信息工程学院 南京210044;
    2 南京信息工程大学江苏省大气环境与装备技术协同创新中心 南京210044
  • 收稿日期:2019-03-27 出版日期:2020-04-15 发布日期:2020-04-15
  • 通讯作者: 周先春(zhouxc2008@163.com)
  • 基金资助:
    国家自然科学基金项目(11202106,61302188);江苏省“信息与通信工程”优势学科建设项目;江苏品牌专业建设工程资助项目

Adaptive Image Inpainting Based on Structural Correlation

ZHOU Xian-chun1,2, XU Yan1   

  1. 1 School of Electronic and Information Engineering,Nanjing University of Information Science and Technology,Nanjing 210044,China;
    2 Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology,Nanjing University of Information Science andTechnology,Nanjing 210044,China
  • Received:2019-03-27 Online:2020-04-15 Published:2020-04-15
  • Contact: XU Yan,born in 1995,postgraduate.Her main research interests include ima-ge processing and so on.
  • About author:ZHOU Xian-chun,born in 1974,Ph.D,associate professor,postgraduate supervision.His main research interests include signal & information processing,and digital image processing.
  • Supported by:
    This work as supported by the National Natural Science Foundation of China(11202106,61302188),“Information and Communication Engineering” Superiority Discipline Construction Project of Jiangsu Province and Jiangsu Brand Professional Construction Project.

摘要: 针对传统的Criminisi修复算法中优先函数计算的不足,以及修复后图像质量下降的问题,文中提出了一种基于结构相关性的自适应图像修复算法。首先,引入结构相关性,对优先权计算进行改进,增加优先权计算的可靠性;然后,自适应选择样本块大小,使修复更加准确并提高修复效率;最后,引入HSV颜色空间,根据样本的色度、亮度来搜寻最佳匹配块,减少修复误差,完成图像恢复。实验结果表明,所提算法在主观视觉上有明显提升,并且在峰值信噪比(PSNR)和结构相似度(SSIM)方面均有一定提高,修复效果明显,与传统的Criminisi修复算法相比,其峰值信噪比提高了1~3dB,结构相似度更接近1。所提算法利用结构相关性和自适应选择样本块大小对彩色破损图像进行修复,优先权计算更加合理准确,修复效率有所提高,修复效果可视性更佳,有利于实际应用。

关键词: HSV颜色空间, 结构相关性, 图像修复, 自适应样本块

Abstract: This paper proposed an adaptive image inpainting algorithm based on structural correlation to solve the problems of inaccurate priority function and degraded image quality in Criminisi inpainting algorithm.First,the structural correlation is introduced to improve the priority calculation and increase the reliability of the priority calculation.Then,the sample size is adaptively selected to make the repair more accurate and improve the efficiency of repair.Finally,HSV color space is introduced,and according to the chromaticity and brightness of sample,the optimal matching block is searched to reduce the repair error and complete the image restoration.Experimental results show that the proposed algorithmhas obvious improvement in subjective visual compared to Criminisi repair algorithm,its peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) are improved,and repair effect is better.Compared with the traditional Criminisi inpainting algorithm,the peak signal-to-noise ratio of proposed algorithm is improved by 1~3dB and structure similarity is closer to 1.This algorithm uses structure correlation adaptively to select sample block size to repair color broken images,making the priority calculation more reasonable and accurate and the repair effect better,which is helpful to practical application.

Key words: Adaptive sample block, HSV color space, Image inpainting, Structural dependence

中图分类号: 

  • TP391
[1]GUILLEMOT C,LE M O.Image inpainting:overview and recent advances[J].IEEE Signal Processing Magazine,2014,31(1):127-144.
[2]ZHANG H Y,PENG Q Z.Overview of digital image restoration technology[J].Journal of Image and Graphics,2007,12(1):1-10.
[3]BERTALMIO M,SAPIRO G,CASELLES V,et al.Image inpainting[J].Proceedings of Siggraph,2000,4(19):417-424.
[4]YU L J,JING,LI Y W.Double Cross Algorithm of Improved TV Image Inpainting Model [J].IEEE 3rd Advanced Information Technology,Electronic and Automation Control Confe-rence,2018,7(5):1097-1100.
[5]CHEN Q C,LI G Y,LI X,et al.Structure guided image completion using texture synthesis and region segmentation[J].Optik,2019,6(4):896-909.
[6]ZHOU X C,WANG M L,SHI L F.Research on image smoothing model based on the combination of gradient and curvature[J].Acta Physica Sinica,2015,64(4):1-7.
[7]LIU Z X,WAN W G.Image Inpainting Algorithm Based on KSVD and Improved CDD[C]// Conference on International Conference on Audio,Language and Image Processing (ICALIP).Shanghai:2018:413-417.
[8]ZHOU X C,WANG M L,ZHOU L F.The image of quasi-normal distribution diffusion is smooth[J].Journal of Image and Graphics,2015,20(2):169-176.
[9]CRIMINISI A,PEREZ P,TOYAMA K.Region filling and object removal by exemplar-based image inpainting[J].IEEE Transactions on Image Processing,2004,13(9):1200-1212.
[10]ZHOU Y T,LI L.Research on weighted priority of exemplarbased image inpainting[J].Journal of Electronics,2012,29(1):166-170.
[11]LI A J,NIU W L.Image inpainting based on improved Criminisi algorithm[J].Computer Engineering and Applications,2014,50(18):167-170.
[12]WANG S M.An unidirectional Criminisi Algorithm for DIBR-synthesized images[C]// 2nd IEEE International Conference on Computer and Communications (ICCC).Chengdu:2016:574-578.
[13]HE K M,SUN J.Image completion approaches using the statistics of similar patches[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(12):2423-2435.
[14]HUANG Y,LI K,YANG M.An Improved Image InpaintingAlgorithm Based on Image Segmentation[J].Procedia Compu-ter Science,2017,107(3):796-801.
[15]ZHI H C,CHAO D,LEI J,et al.Structure-aware image inpainting using patch scale optimization[J].Journal of Visual Communication and Image Representation,2016,40(1):312-323.
[16]WANG P Y,ZHAO D H,LI M F.Target visible light camouflage effect evaluation based on image inpainting technology[J].Advances in laser and optoelectronics,2018,55(3):31011.
[17]ZHANG Q H,SHI P F.Edge extraction method based on HSV space color image[J].Computer Simulation,2000,11(17):25-32.
[18]SIADAT S Z,YAGHMAEE F,MAHDAV P.A new exemplar-based image inpainting algorithm using image structure tensors[C]//Proceeding of the 24th Iranian Conference on Electrical Engineering.Shiraz,Iran:IEEE,2016:995-1001.
[19]DOU L Y,XU D,LI J,et al.Image inpainting based on double tree complex wavelet[J].Computer Science,2017,44(1):179-182,191.
[1] 赵露露, 沈玲, 洪日昌.
图像修复研究进展综述
Survey on Image Inpainting Research Progress
计算机科学, 2021, 48(3): 14-26. https://doi.org/10.11896/jsjkx.210100048
[2] 刘浪, 李梁, 但远宏.
用于视频修复的连贯语义时空注意力网络
Coherent Semantic Spatial-Temporal Attention Network for Video Inpainting
计算机科学, 2021, 48(10): 239-245. https://doi.org/10.11896/jsjkx.200600130
[3] 孟丽莎, 任坤, 范春奇, 黄泷.
基于密集卷积生成对抗网络的图像修复
Dense Convolution Generative Adversarial Networks Based Image Inpainting
计算机科学, 2020, 47(8): 202-207. https://doi.org/10.11896/jsjkx.190700017
[4] 王晓, 邹泽伟, 李勃勃, 王静.
基于多特征融合的彩色图像声呐目标检测
Target Detection in Colorful Imaging Sonar Based on Multi-feature Fusion
计算机科学, 2019, 46(6A): 177-181.
[5] 甘玲, 赵福超, 杨梦.
一种自适应组稀疏表示的图像修复方法
Self-adaptive Group Sparse Representation Method for Image Inpainting
计算机科学, 2018, 45(8): 272-276. https://doi.org/10.11896/j.issn.1002-137X.2018.08.049
[6] 张雷,康宝生.
基于结构稀疏度和块差异度的目标移除图像修复
Image Inpainting for Object Removal Based on Structure Sparsity and Patch Difference
计算机科学, 2018, 45(5): 255-259. https://doi.org/10.11896/j.issn.1002-137X.2018.05.044
[7] 孙全, 曾晓勤.
基于生成对抗网络的图像修复
Image Inpainting Based on Generative Adversarial Networks
计算机科学, 2018, 45(12): 229-234. https://doi.org/10.11896/j.issn.1002-137X.2018.12.038
[8] 胡志军, 刘广海, 苏又.
局部自相关函数在基于内容的图像检索中的应用
Application of Local Autocorrelation Function in Content-based Image Retrieval
计算机科学, 2018, 45(11A): 259-262.
[9] 窦立云,徐丹,李杰,陈浩,刘义成.
基于双树复小波的图像修复
Image Inpainting Based on Dual-tree Complex Wavelet Transform
计算机科学, 2017, 44(Z6): 179-182. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.041
[10] 祝轩,张旭峰,李秋菊,王宁,陶吉瑶.
基于稀疏分解的图像修复方法
Image Inpainting Method Based on Sparse Decomposition
计算机科学, 2016, 43(1): 294-297. https://doi.org/10.11896/j.issn.1002-137X.2016.01.063
[11] 睢 丹,高国伟.
基于人工鱼群微细分解的先验未知像素点修复算法
Image Restoration Algorithm of Unknown Priori Pixel Based on Artificial Fish Swarm Decomposition
计算机科学, 2015, 42(3): 316-320. https://doi.org/10.11896/j.issn.1002-137X.2015.03.065
[12] 胡文瑾,刘仲民,李战明.
一种改进的小波域图像修复算法
Improved Algorithm for Image Inpainting in Wavelet Domains
计算机科学, 2014, 41(5): 299-303. https://doi.org/10.11896/j.issn.1002-137X.2014.05.064
[13] 翟东海,李同亮,段维夏,鱼江,肖杰.
基于矩阵相似度的最佳样本块匹配算法及其在图像修复中的应用
Optimal Exemplar Matching Algorithm Based on Matrix Similarity and its Application in Image Inpainting
计算机科学, 2014, 41(1): 307-310.
[14] 刘纯利,张弓.
基于小波框架的盲图像修复研究
Wavelet Frame Based Blind Image Inpainting
计算机科学, 2013, 40(4): 295-297.
[15] 刘广海,吴璟莉.
基于颜色体积直方图的图像检索
Image Retrieval Based on Color Volume Histogram
计算机科学, 2012, 39(1): 273-275.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!