Computer Science ›› 2019, Vol. 46 ›› Issue (7): 13-21.doi: 10.11896/j.issn.1002-137X.2019.07.003

• Surveys • Previous Articles     Next Articles

Summary of Stylized Line Drawing Generation

LIU Zi-qi,LIU Shi-guang   

  1. (College of Intelligence and Computing,Tianjin University,Tianjin 300350,China)
  • Received:2018-08-21 Online:2019-07-15 Published:2019-07-15

Abstract: Line drawing has a great advantage in the transmission of visual information.As a simple and effective means of visual communication,it stresses main features of the details so that people can get the main information quickly.At the same time,stylized line drawing,as an art form,enables people to appreciate and understand their artistic characte-ristics quickly.Line drawing generation technology can be divided into 2D image-based methods and 3D image-based methods.Line drawing generation technology based on 2D images includes deep learning method and traditional me-thod,which contains data drive method and non-data-driven method.Line drawing generation technology based on 3D model contains image space method,object space method and their blending method.By introducing and analyzing va-rious methods and analyzing the advantages and disadvantages of different methods with comparisons among them,this paper summarized the existing problems of line drawing generation technology and their possible solutions.And on this basis,the future development trend of line painting was prospected.

Key words: 2D image, 3D model, Data-driven, Example-based, Line drawing, Style

CLC Number: 

  • TP391
[1]KANG H,LEE S,CHUI C K.Coherent Line Drawing[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:43-50.
[2]ISENBERG T,FREUDENBERG B,HALPER N,et al.A Developer’s Guide to Silhouette Algorithms for Polygonal Models[J].IEEE Computer Graphics & Applications,2003,23(4):28-37.
[3]BERGER I,SHAMIR A,MAHLER M,et al.Style and Abstrac- tion in Portrait Sketching[J].ACM Transactions on Graphics,2013,32(4):1-12.
[4]CHEN H,ZHENG N N,XU Y Q,et al.Image Line Drawing Generation System Based on Sample Learning[J].Journal of Software,2003,14(2):202-208.(in Chinese)
陈洪,郑南宁,徐迎庆,等.基于样本学习的人像线条画生成系统[J].软件学报,2003,14(2):202-208.
[5]SONG Y B,BAO L C,YANG Q X,et al.Real-Time Exemplar-Based Face Sketch Synthesis[C]∥European Conference on Computer Vision.Berlin Heidelberg:Springer,2014:800-813.
[6]WANG N N,ZHANG S C,GAO X B,et al.Unified Framework for Face Sketch Synthesis[J].Signal Processing,2017,130:1-11.
[7]LIANG Y,SONG M,XIE L,et al.Face Sketch-to-Photo Synthesis from Simple Line Drawing[C]∥Signal & Information Processing Association Summit and Conference.Washington,DC,USA:IEEE,2012:1-5.
[8]WANG X,OXHOLM G,ZHANG D,et al.Multimodal Transfer:a Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer[C]∥Computer Vision and Pattern Re-cognition.Washington,DC,USA:IEEE,2017:7178-7186.
[9]GATYS L A,ECKER A S,BETHGE M.Image Style Transfer Using Convolutional Neural Networks[C]∥Computer Vision and Pattern Recognition.Washington,DC,USA:IEEE,2016:2414-2423.
[10]KAUR P,ZHANG H,DANA K J.Photo-Realistic Facial Texture Transfer[J].arXiv:1706.04306,2017.
[11]CANNY J.A Computational Approach to Edge Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1986,8(6):679-698.
[12]LINE F C,KANG M,LIN X.Improved Canny Edge Detection Algorithm[J].Journal of Computer Science,2016,43(8):309-312.(in Chinese)
凌凤彩,康牧,林晓.改进的Canny边缘检测算法[J].计算机科学,2016,43(8):309-312.
[13]DECARLO D,SANTELLA A.Stylization and Abstraction of Photographs[J].ACM Transactions on Graphics,2002,21(3):769-776.
[14]KANG H W,CHUI C K,CHAKRABORTY U K.A Unified Scheme for Adaptive Stroke-Based Rendering[M].New York:Springer-Verlag,2006:814-824.
[15]LI R L,LIANG Y,ZHANG S H.Cartoon Video Segmentation and Vectorization Based on Canny Optimization[J].Journal of Computer Science,2017,44(8):27-30.(in Chinese)
李瑞龙,梁缘,张松海.基于Canny优化的卡通视频分割与矢量化[J].计算机科学,2017,44(8):27-30.
[16]ORZAN A,BOUSSEAU A,BARLA P.Structure-Preserving Manipulation of Photographs[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:103-110.
[17]FISCHAR J,BARTZ D,STRABER W.Stylized Augmented Rea- lity for Improved Immersion[C]∥Virtual Reality.Washington,DC,USA:IEEE,2005:195-202.
[18]LIANG B,DAI F,ZHAO F Q.Images Line Drawings Generation by Edge Tracking Algorithm[J].Journal of Image & Graphics,2011,16(11):2074-2080.(in Chinese)
梁波,戴芳,赵凤群.边缘跟踪算法的图像线条画生成[J].中国图象图形学报,2011,16(11):2074-2080.
[19]GOOCH B,REINHARD E,GOOCH A.Human Facial Illustrations:Creation and Psychophysical Evaluation[J].ACM Tran-sactions on Graphics,2004,23(1):27-44.
[20]MARR D,HILDRESH E.Theory of Edge Detection[J].Proceedings of the Royal Society of London,1980,207(1167):187-217.
[21]WINNEMOLLER H,OLSEN S C,GOOCH B.Real-Time Video Abstraction[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2006:1221-1226.
[22]WINNEMOLLER H,KYPRIANIDIS J E,OLSEN S C.XDoG:An Extended Difference-of-Gaussians Compendium Including Advanced Image Stylization[J].Computers & Graphics,2012,36(6):740-753.
[23]ROSIN P L,LAI Y K.Artistic Minimal Rendering with Lines and Blocks[J].Graphical Models,2013,75(4):208-229.
[24]KANG H,LEE S,CHUI C K.Flow-Based Image Abstraction [J].IEEE Transactions on Visualization & Computer Graphics,2009,15(1):62-76.
[25]WANG S D,MA Z Y,LIU X H,et al.Coherence-Enhancing Line Drawing for Color Images[J].Science China Information Sciences,2013,56(11):1-11.
[26]WANG S D,WU E,LIU Y Q,et al.Abstract Line Drawings from Photographs Using Flow-Based Filters[J].Computers & Graphics,2014,36(4):224-231.
[27]WANG S D,LIU X H,CHEN Y Y,et al.Abstract Line Dra- wing Generation Based on Characteristic Flow[J].Journal of Computer Science,2014,37(3):611-620.(in Chinese)
王山东,刘学慧,陈彦云,等.基于特征流的抽象线条画绘制[J].计算机学报,2014,37(3):611-620.
[28]SON M,KANG H,LEE Y,et al.Abstract Line Drawings from 2D Images[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,2007:333-342.
[29]ZHAO J X,LI X H,CHONG F.Abstract Line Drawings from 2D Images Based on Thinning[C]∥Congress on Image and Signal Processing.Washington,DC,USA:IEEE,2008:466-470.
[30]LUO G R,SU H G.Method of Line-Drawing Generation Based on Wavelet Multiresolution Analysis[J].Computer Engineering &Design,2010,31(17):3848-3851.(in Chinese)
罗光蕊,苏鸿根.基于小波多分辨率分析的线条画生成方法[J].计算机工程与设计,2010,31(17):3848-3851.
[31]HU G W,WEI F.Intelligent Clean Line Drawing[C]∥International Conference on Robots & Intelligent System.Washington,DC,USA:IEEE,2016:217-220.
[32]TSAI H C,LEE Y H,LEE R R,et al.User-Guided Line Abstraction Using Coherence and Structure Analysis[J].Computational Visual Media,2017,3(2):1-12.
[33]COLE F,GOLOVINSKIY A,LIMPAECHER A,et al.Where Do People Draw Lines?[J].ACM Transactions on Graphics,2008,27(3):1-11.
[34]MINEAR M,PARK D C.A Lifespan Database of Adult Facial Stimuli[J].Behavior Research Methods,Instruments,& Computers,2004,36(4):630-633.
[35]ZHANG Y,DONG W M,MA C,et al.Data-Driven Synthesis of Cartoon Faces Using Different Styles[J].IEEE Transactions on Image Processing,2017,26(1):464-478.
[36]BEN-ZVI N,BENTO J,MAHLER M,et al.Line-Drawing Video Stylization[J].Computer Graphics Forum,2016,35(6):18-32.
[37]RUSINKIEWICZ S,COLE F,DECAROL D,et al.Line Dra- wings from 3D Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2008:1-3.
[38]SAITO T,TAKAHASHI T.Comprehensible Rendering of 3-D Shapes[J].Computer Graphics,1990,24(4):197-206.
[39]HERTAMZNN A.Introduction to 3D Non-Photorealistic Rendering:Silhouettes and Outlines[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:1-14.
[40]LOVISCACH J.Rendering Artistic Line Drawings Using Off-the-Shelf 3-D Software[C]∥Eurographics.Washington,DC,USA:IEEE,2002:125-130.
[41]RASKAR R,TAN K H,FERIS R,et al.Non-Photorealistic Camera:Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2004:679-688.
[42]LEE Y,LEE S,MARKOSIAN L,et al.Line Drawings via Abstracted Shading[J].ACM Transactions on Graphics,2007,26(3):18-23.
[43]BUCHANAN J W,SOUSA M C.The Edge Buffer:A Data Structure for Easy Silhouette Rendering[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2000:39-42.
[44]LIU J,ZHOU M Q,GENG G H,et al.Drawing Method of Cultural Line Map Based on Visual Curvature Estimation[J].Journal of Computer Science,2017,44(S2):244-250.(in Chinese)
刘军,周明全,耿国华,等.基于视觉曲率估算的文物线图绘制方法[J].计算机科学,2017,44(S2):244-250.
[45]MCGUIRE M,HUGHES J F.Hardware-Determined Feature Edges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2004:35-47.
[46]SANDER P V,GU X F,HOPPE H,et al.Silhouette Clipping[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2000:327-334.
[47]GOOCH B,SLOAN P P J,GOOCH A,et al.Interactive Technical Illustration[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:31-38.
[48]BENICHOU F,ELBER G.Output Sensitive Extraction of Silhouettes From Polygonal Geometry[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,1999:60-70.
[49]HERTZMANN A,ZORIN D.Illustrating Smooth Surfaces[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,2000:517-526.
[50]BUCHHOLZ H,DOLLNER J,NIENHAUS M,et al.Real-Time Non-Photorealistic Rendering of 3D City Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2005:83-88.
[51]DECAROL D,FINKELSTEIN A,RUSINKIEWICZ S,et al. Suggestive Contours for Conveying Shape[J].ACM Transactions on Graphics,2003,22(3):848-855.
[52]OHTAKE Y,BELYAEV A,SEIDEL H P.Ridge-Valley Lines on Meshes via Implicit Surface Fitting[J].ACM Transactions on Graphics,2004,23(3):609-612.
[53]JUDD T,DURAND F,ADELSON E.Apparent Ridges for Line Drawing[J].ACM Transactions on Graphics,2007,26(3):19-26.
[54]DECAROL D,RUSINKIEWICZ S.Highlight Lines for Conve- ying Shape[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:63-70.
[55]XIE X X,HE Y,TIAN F,et al.An Effective Illustrative Visua- lization Framework Based on Photic Extremum Lines (PELs)[J].IEEE Transactions on Visualization & Computer Graphics,2007,13(6):1328-1335.
[56]KOLOMENKIN M,SHIMSHONI I,TAL A.Demarcating Curves for Shape Illustration[J].ACM Transactions on Graphics,2008,27(5):1-9.
[57]COLE F,SANIK K,DECAROL D,et al.How Well do Line Drawings Depict Shape?[J].ACM Transactions on Graphics,2009,28(3):1-9.
[58]GRABLI S,TURQUIN E,et al.Programmable Rendering of Line Drawing from 3D Scenes[J].ACM Transactions on Graphics,2010,29(2):1-20.
[59]RASKAR R,COHEN M.Image Precision Silhouette Edges[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,1999:135-140.
[60]RASKAR R.Hardware Support for Non-Photorealistic Rende- ring[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2001:41-47.
[61]XU H,NGUYEN M X,YUAN X R,et al.Interactive Silhouette Rendering for Point-based Models[C]∥Eurographics.Wa-shington,DC,USA:IEEE,2008:13-18.
[62]ZHENG H D.Evaluation Method of Face Stylized Rendering [D].Jinan:Shandong University,2015.(in Chinese)
郑海东.人脸风格化绘制评估方法[D].济南:山东大学,2015.
[63]SALSIN D H.Non-Photorealistic Animation & Rendering:7 Grand Challenges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2002.
[64]GOOCH B S,GOOCH A A,JI L,et al.Viewing Progress in Non-Photorealistic Rendering Through Heinlein’s Lens[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:165-171.
[65]HERTAMANN A.Non-Photorealistic Rendering and the Science of Art[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:147-157.
[66]GOODWIN T,VOLLICK I,HERTZMANN A.Isophote Dis- tance:A Shading Approach to Artistic Stroke Thickness[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:53-62.
[1] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[2] LIU Chang, WEI Wei-min, MENG Fan-xing, CAI Zhi. Research Progress on Speech Style Transfer [J]. Computer Science, 2022, 49(6A): 301-308.
[3] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[4] CHEN Zhang-hui, XIONG Yun. Stylized Image Captioning Model Based on Disentangle-Retrieve-Generate [J]. Computer Science, 2022, 49(6): 180-186.
[5] NING Qiu-yi, SHI Xiao-jing, DUAN Xiang-yu, ZHANG Min. Unsupervised Domain Adaptation Based on Style Aware [J]. Computer Science, 2022, 49(1): 271-278.
[6] XU Hua-jie, ZHANG Chen-qiang, SU Guo-shao. Accurate Segmentation Method of Aerial Photography Buildings Based on Deep Convolutional Residual Network [J]. Computer Science, 2021, 48(8): 169-174.
[7] YE Hong-liang, ZHU Wan-ning, HONG Lei. Music Style Transfer Method with Human Voice Based on CQT and Mel-spectrum [J]. Computer Science, 2021, 48(6A): 326-330.
[8] GUO Jie, GAO Xi-ran, CHEN Li, FU You, LIU Ying. Parallelizing Multigrid Application Using Data-driven Programming Model [J]. Computer Science, 2020, 47(8): 32-40.
[9] ZHANG Mei-yu, LIU Yue-hui, QIN Xu-jia, WU Liang-wu. Neural Style Transfer Method Based on Laplace Operator to Suppress Artifacts [J]. Computer Science, 2020, 47(11A): 209-214.
[10] WANG Xin, MENG Hao-hao, JIANG Xiao-tao, CHEN Sheng-yong, SUN Ling-yun. Survey on Character Motion Synthesis Based on Neural Network [J]. Computer Science, 2019, 46(9): 22-27.
[11] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
[12] LI Yin-min, XUE Kai-xin, GAO Zan, XUE Yan-bin, XU Guang-ping, ZHANG Hua. 3-D Model Retrieval Algorithm Based on Residual Network [J]. Computer Science, 2019, 46(3): 148-153.
[13] ZHOU Ming,JIA Yan-ming,ZHOU Cai-lan,XU Ning. English Automated Essay Scoring Methods Based on Discourse Structure [J]. Computer Science, 2019, 46(3): 234-241.
[14] LIU Hong-lin, SHUAI Ren-jun. Method of Fast Neural Style Transfer with Spatial Constraint [J]. Computer Science, 2019, 46(3): 283-286.
[15] LIU Zhi, LI Jiang-chuan. 3D Model Retrieval Based on Deep Convolution Neural Network [J]. Computer Science, 2019, 46(1): 278-284.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!