Computer Science ›› 2016, Vol. 43 ›› Issue (10): 292-296.doi: 10.11896/j.issn.1002-137X.2016.10.055

Previous Articles     Next Articles

Large Damaged Area Image Inpainting Algorithm Based on Matching Model for Broken Structure Line

NIE Hong-yu, ZHAI Dong-hai, YU Jiang and WANG Meng   

  • Online:2018-12-01 Published:2018-12-01

Abstract: To solve the problems such as mismatching connecting or unsmooth connecting,when inpainting large damaged region with complicated structure information,an image inpainting algorithm based on matching model for broken structure line was proposed in this paper.Firstly,several potential factors which impact the calculation of the matching degree between the broken structure lines are analyzed deeply,and different weights are assigned into different factors based on their significance.On that basis,a matching model for broken structure lines is constructed to get matching pairs among these broken structure lines.Secondly,the fitting structure lines can be obtained smoothly according to these matching pairs,and they can partition the large damaged region into different blocks.At last,block matching algorithm is adopted to pixel filling in these damaged blocks.Compared with improved Crimimsi algorithm,Hays algorithm and IIPBDR algorithm in 6 experiments,our approach can match the broken structure lines accurately,and can smoothly connect these broken structure lines guided by the matching result.The experimental results demonstrate that our approach can effectively inpaint large damage region with complicated structure,and its inpainting result has a better visualconnectivity.

Key words: Large damaged region,Broken structure line,Matching model,Matching degree,Block inpainting

[1] Bertalmio M,Sapiro G,Caselles V,et al.Image inpainting[C]∥Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques,ACM IGGRAPH,ACM Transactions on Graphics (TOG).New Orleans,LA,USA,2000:417-424
[2] Bertalmio C,Bertalmio M,Caselles V,et al.Filling-in by jointinterpolation of vector fields and gray levels[J].IEEE Transactions on Image Processing,2001,10(8):1200-1211
[3] Chan T,Shen J.Mathematical models for local nontexture inpaintings[J].SIAM Journal on Applied Mathematics,2002,62(3):1019-1043
[4] Criminisi A,Perez P,Toyama K.Object removal by exemplar-based inpainting[C]∥Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR).Vol.2,Madison,WI,USA,2003:721-728
[5] Le Meur O,Gautier J,Guillemot C.Examplar-based inpainting based on local geometry[C]∥IEEE International Conference on Image Processing (ICIP).IEEE Press,2011:3401-3404
[6] He K M,Sun J.Image Completion Approaches Using the Statistics of Similar Patches[J].IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI),2014,6(12):2423-2435
[7] Guillemot C,Turkan M,Le Meur O,et al.Image inpainting using LLE-LDNR and linear subspace mappings[C]∥IEEE International Conference on Acoustics,Speech,and Signal Processing (ICASSP).IEEE Press,2013:1558-1562
[8] Liu Y Q,Caselles V.Exemplar-based image inpainting usingmultiscale graph cuts[J].IEEE Transactions on Image Processing,2013,2(5):1699-1711
[9] Arias P,Facciolo G,Caselles V,et al.A variational framework for exemplar-based image inpainting[J].International Journal of Computer Vision,2011,3(3):319-347
[10] Elad M.Sparse and redundant representations:from theory to applications in signal and image processing[M].New York:Springer,2010
[11] Studer C,Kuppinger P,Pope G,et al.Recovery of sparsely corrupted signals[J].IEEE Transaction on Information Theory,2012,58(5):3115-3130
[12] Bugeau A,Bertalmio M,Caselles V,et al.A comprehensiveframework for image inpainting[J].IEEE Transaction on Image Processing,2010,19(10):2634-2645
[13] Sun J,Yuan L,Jia J,et al.Image completion with structurepropagation[C]∥Proceedings of the 32nd International Confe-rence on Computer Graphics and Interactive Techniques,ACM SIGGRAPH,ACM Transactions on Graphics (TOG).vol.24 of 3,Los Angeles,CA,USA,2005:861-868
[14] Hays J,Efros A A.Scene completion using millions of photographs[J].Communications of the ACM,2008,51(10):87-94
[15] Zhai D H,Yu J,Duan W X,et al.Image inpainting algorithm based on partition block of damaged region[J].Journal of Image and Graphics,2014,9(6):835-842(in Chinese) 翟东海,鱼江,段维夏,等.破损区域分块划分的图像修复[J].中国图象图形学报,2014,9(6):835-842
[16] Xu L,Yan Q,Xia Y,et al.Structure Extraction from Texture via Relative Total Variation[J].ACM Transactions on Graphics,2012,1(6):439-445
[17] Wu X J,Li G Q.Large Scale Image Inpainting Based on Exemplar and Structure Information [J].Acta Electronica Sinica,2012,0(8):1509-1514(in Chinese) 吴晓军,李功清.基于样本和线性结构信息的大范围图像修复算法[J].电子学报,2012,40(8):1509-1514
[18] Wang X N,Wang Z,Wang Y.Inproved Criminisi algorithmbased on geometry distance[J].Computers Engineering and Design,2015,36(7):1835-1839(in Chinese) 王新年,王哲,王演.基于几何距离的Criminisi图像修复算法[J].计算机工程与设计,2015,36(7):1835-1839
[19] Wang Z,Bovik A C,Sheikh Hamid R,et al.Image quality assessment:from error visibility to struetural similarity[J].IEEE Transactions on Image Proeessing,2004,3(4):600-612
[20] Wang Z,Bovik A C.A universal image quality index[J].IEEE Signal Processing Letters,2002,9(3):81-84

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!