Computer Science ›› 2016, Vol. 43 ›› Issue (10): 292-296, 303.doi: 10.11896/j.issn.1002-137X.2016.10.055

Previous Articles     Next Articles

Large Damaged Area Image Inpainting Algorithm Based on Matching Model for Broken Structure Line

NIE Hong-yu, ZHAI Dong-hai, YU Jiang and WANG Meng   

  • Online:2018-12-01 Published:2018-12-01

Abstract: To solve the problems such as mismatching connecting or unsmooth connecting,when inpainting large damaged region with complicated structure information,an image inpainting algorithm based on matching model for broken structure line was proposed in this paper.Firstly,several potential factors which impact the calculation of the matching degree between the broken structure lines are analyzed deeply,and different weights are assigned into different factors based on their significance.On that basis,a matching model for broken structure lines is constructed to get matching pairs among these broken structure lines.Secondly,the fitting structure lines can be obtained smoothly according to these matching pairs,and they can partition the large damaged region into different blocks.At last,block matching algorithm is adopted to pixel filling in these damaged blocks.Compared with improved Crimimsi algorithm,Hays algorithm and IIPBDR algorithm in 6 experiments,our approach can match the broken structure lines accurately,and can smoothly connect these broken structure lines guided by the matching result.The experimental results demonstrate that our approach can effectively inpaint large damage region with complicated structure,and its inpainting result has a better visualconnectivity.

Key words: Large damaged region,Broken structure line,Matching model,Matching degree,Block inpainting

[1] Bertalmio M,Sapiro G,Caselles V,et al.Image inpainting[C]∥Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques,ACM IGGRAPH,ACM Transactions on Graphics (TOG).New Orleans,LA,USA,2000:417-424
[2] Bertalmio C,Bertalmio M,Caselles V,et al.Filling-in by jointinterpolation of vector fields and gray levels[J].IEEE Transactions on Image Processing,2001,10(8):1200-1211
[3] Chan T,Shen J.Mathematical models for local nontexture inpaintings[J].SIAM Journal on Applied Mathematics,2002,62(3):1019-1043
[4] Criminisi A,Perez P,Toyama K.Object removal by exemplar-based inpainting[C]∥Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR).Vol.2,Madison,WI,USA,2003:721-728
[5] Le Meur O,Gautier J,Guillemot C.Examplar-based inpainting based on local geometry[C]∥IEEE International Conference on Image Processing (ICIP).IEEE Press,2011:3401-3404
[6] He K M,Sun J.Image Completion Approaches Using the Statistics of Similar Patches[J].IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI),2014,6(12):2423-2435
[7] Guillemot C,Turkan M,Le Meur O,et al.Image inpainting using LLE-LDNR and linear subspace mappings[C]∥IEEE International Conference on Acoustics,Speech,and Signal Processing (ICASSP).IEEE Press,2013:1558-1562
[8] Liu Y Q,Caselles V.Exemplar-based image inpainting usingmultiscale graph cuts[J].IEEE Transactions on Image Processing,2013,2(5):1699-1711
[9] Arias P,Facciolo G,Caselles V,et al.A variational framework for exemplar-based image inpainting[J].International Journal of Computer Vision,2011,3(3):319-347
[10] Elad M.Sparse and redundant representations:from theory to applications in signal and image processing[M].New York:Springer,2010
[11] Studer C,Kuppinger P,Pope G,et al.Recovery of sparsely corrupted signals[J].IEEE Transaction on Information Theory,2012,58(5):3115-3130
[12] Bugeau A,Bertalmio M,Caselles V,et al.A comprehensiveframework for image inpainting[J].IEEE Transaction on Image Processing,2010,19(10):2634-2645
[13] Sun J,Yuan L,Jia J,et al.Image completion with structurepropagation[C]∥Proceedings of the 32nd International Confe-rence on Computer Graphics and Interactive Techniques,ACM SIGGRAPH,ACM Transactions on Graphics (TOG).vol.24 of 3,Los Angeles,CA,USA,2005:861-868
[14] Hays J,Efros A A.Scene completion using millions of photographs[J].Communications of the ACM,2008,51(10):87-94
[15] Zhai D H,Yu J,Duan W X,et al.Image inpainting algorithm based on partition block of damaged region[J].Journal of Image and Graphics,2014,9(6):835-842(in Chinese) 翟东海,鱼江,段维夏,等.破损区域分块划分的图像修复[J].中国图象图形学报,2014,9(6):835-842
[16] Xu L,Yan Q,Xia Y,et al.Structure Extraction from Texture via Relative Total Variation[J].ACM Transactions on Graphics,2012,1(6):439-445
[17] Wu X J,Li G Q.Large Scale Image Inpainting Based on Exemplar and Structure Information [J].Acta Electronica Sinica,2012,0(8):1509-1514(in Chinese) 吴晓军,李功清.基于样本和线性结构信息的大范围图像修复算法[J].电子学报,2012,40(8):1509-1514
[18] Wang X N,Wang Z,Wang Y.Inproved Criminisi algorithmbased on geometry distance[J].Computers Engineering and Design,2015,36(7):1835-1839(in Chinese) 王新年,王哲,王演.基于几何距离的Criminisi图像修复算法[J].计算机工程与设计,2015,36(7):1835-1839
[19] Wang Z,Bovik A C,Sheikh Hamid R,et al.Image quality assessment:from error visibility to struetural similarity[J].IEEE Transactions on Image Proeessing,2004,3(4):600-612
[20] Wang Z,Bovik A C.A universal image quality index[J].IEEE Signal Processing Letters,2002,9(3):81-84

No related articles found!
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[2] XIA Qing-xun and ZHUANG Yi. Remote Attestation Mechanism Based on Locality Principle[J]. Computer Science, 2018, 45(4): 148 -151, 162 .
[3] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[4] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[5] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[6] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[7] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[8] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[9] ZHONG Fei and YANG Bin. License Plate Detection Based on Principal Component Analysis Network[J]. Computer Science, 2018, 45(3): 268 -273 .
[10] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99, 116 .