Computer Science ›› 2019, Vol. 46 ›› Issue (7): 13-21.doi: 10.11896/j.issn.1002-137X.2019.07.003

• Surveys • Previous Articles     Next Articles

Summary of Stylized Line Drawing Generation

LIU Zi-qi,LIU Shi-guang   

  1. (College of Intelligence and Computing,Tianjin University,Tianjin 300350,China)
  • Received:2018-08-21 Online:2019-07-15 Published:2019-07-15

Abstract: Line drawing has a great advantage in the transmission of visual information.As a simple and effective means of visual communication,it stresses main features of the details so that people can get the main information quickly.At the same time,stylized line drawing,as an art form,enables people to appreciate and understand their artistic characte-ristics quickly.Line drawing generation technology can be divided into 2D image-based methods and 3D image-based methods.Line drawing generation technology based on 2D images includes deep learning method and traditional me-thod,which contains data drive method and non-data-driven method.Line drawing generation technology based on 3D model contains image space method,object space method and their blending method.By introducing and analyzing va-rious methods and analyzing the advantages and disadvantages of different methods with comparisons among them,this paper summarized the existing problems of line drawing generation technology and their possible solutions.And on this basis,the future development trend of line painting was prospected.

Key words: Line drawing, Style, 2D image, 3D model, Example-based, Data-driven

CLC Number: 

  • TP391
[1] KANG H,LEE S,CHUI C K.Coherent Line Drawing[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:43-50.
[2] ISENBERG T,FREUDENBERG B,HALPER N,et al.A Developer’s Guide to Silhouette Algorithms for Polygonal Models[J].IEEE Computer Graphics & Applications,2003,23(4):28-37.
[3] BERGER I,SHAMIR A,MAHLER M,et al.Style and Abstrac- tion in Portrait Sketching[J].ACM Transactions on Graphics,2013,32(4):1-12.
[4] CHEN H,ZHENG N N,XU Y Q,et al.Image Line Drawing Generation System Based on Sample Learning[J].Journal of Software,2003,14(2):202-208.(in Chinese)陈洪,郑南宁,徐迎庆,等.基于样本学习的人像线条画生成系统[J].软件学报,2003,14(2):202-208.
[5] SONG Y B,BAO L C,YANG Q X,et al.Real-Time Exemplar-Based Face Sketch Synthesis[C]∥European Conference on Computer Vision.Berlin Heidelberg:Springer,2014:800-813.
[6] WANG N N,ZHANG S C,GAO X B,et al.Unified Framework for Face Sketch Synthesis[J].Signal Processing,2017,130:1-11.
[7] LIANG Y,SONG M,XIE L,et al.Face Sketch-to-Photo Synthesis from Simple Line Drawing[C]∥Signal & Information Processing Association Summit and Conference.Washington,DC,USA:IEEE,2012:1-5.
[8] WANG X,OXHOLM G,ZHANG D,et al.Multimodal Transfer:a Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer[C]∥Computer Vision and Pattern Re-cognition.Washington,DC,USA:IEEE,2017:7178-7186.
[9] GATYS L A,ECKER A S,BETHGE M.Image Style Transfer Using Convolutional Neural Networks[C]∥Computer Vision and Pattern Recognition.Washington,DC,USA:IEEE,2016:2414-2423.
[10] KAUR P,ZHANG H,DANA K J.Photo-Realistic Facial Texture Transfer[J].arXiv:1706.04306,2017.
[11] CANNY J.A Computational Approach to Edge Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1986,8(6):679-698.
[12] LINE F C,KANG M,LIN X.Improved Canny Edge Detection Algorithm[J].Journal of Computer Science,2016,43(8):309-312.(in Chinese)凌凤彩,康牧,林晓.改进的Canny边缘检测算法[J].计算机科学,2016,43(8):309-312.
[13] DECARLO D,SANTELLA A.Stylization and Abstraction of Photographs[J].ACM Transactions on Graphics,2002,21(3):769-776.
[14] KANG H W,CHUI C K,CHAKRABORTY U K.A Unified Scheme for Adaptive Stroke-Based Rendering[M].New York:Springer-Verlag,2006:814-824.
[15] LI R L,LIANG Y,ZHANG S H.Cartoon Video Segmentation and Vectorization Based on Canny Optimization[J].Journal of Computer Science,2017,44(8):27-30.(in Chinese)李瑞龙,梁缘,张松海.基于Canny优化的卡通视频分割与矢量化[J].计算机科学,2017,44(8):27-30.
[16] ORZAN A,BOUSSEAU A,BARLA P.Structure-Preserving Manipulation of Photographs[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:103-110.
[17] FISCHAR J,BARTZ D,STRABER W.Stylized Augmented Rea- lity for Improved Immersion[C]∥Virtual Reality.Washington,DC,USA:IEEE,2005:195-202.
[18] LIANG B,DAI F,ZHAO F Q.Images Line Drawings Generation by Edge Tracking Algorithm[J].Journal of Image & Graphics,2011,16(11):2074-2080.(in Chinese)梁波,戴芳,赵凤群.边缘跟踪算法的图像线条画生成[J].中国图象图形学报,2011,16(11):2074-2080.
[19] GOOCH B,REINHARD E,GOOCH A.Human Facial Illustrations:Creation and Psychophysical Evaluation[J].ACM Tran-sactions on Graphics,2004,23(1):27-44.
[20] MARR D,HILDRESH E.Theory of Edge Detection[J].Proceedings of the Royal Society of London,1980,207(1167):187-217.
[21] WINNEMOLLER H,OLSEN S C,GOOCH B.Real-Time Video Abstraction[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2006:1221-1226.
[22] WINNEMOLLER H,KYPRIANIDIS J E,OLSEN S C.XDoG:An Extended Difference-of-Gaussians Compendium Including Advanced Image Stylization[J].Computers & Graphics,2012,36(6):740-753.
[23] ROSIN P L,LAI Y K.Artistic Minimal Rendering with Lines and Blocks[J].Graphical Models,2013,75(4):208-229.
[24] KANG H,LEE S,CHUI C K.Flow-Based Image Abstraction [J].IEEE Transactions on Visualization & Computer Graphics,2009,15(1):62-76.
[25] WANG S D,MA Z Y,LIU X H,et al.Coherence-Enhancing Line Drawing for Color Images[J].Science China Information Sciences,2013,56(11):1-11.
[26] WANG S D,WU E,LIU Y Q,et al.Abstract Line Drawings from Photographs Using Flow-Based Filters[J].Computers & Graphics,2014,36(4):224-231.
[27] WANG S D,LIU X H,CHEN Y Y,et al.Abstract Line Dra- wing Generation Based on Characteristic Flow[J].Journal of Computer Science,2014,37(3):611-620.(in Chinese)王山东,刘学慧,陈彦云,等.基于特征流的抽象线条画绘制[J].计算机学报,2014,37(3):611-620.
[28] SON M,KANG H,LEE Y,et al.Abstract Line Drawings from 2D Images[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,2007:333-342.
[29] ZHAO J X,LI X H,CHONG F.Abstract Line Drawings from 2D Images Based on Thinning[C]∥Congress on Image and Signal Processing.Washington,DC,USA:IEEE,2008:466-470.
[30] LUO G R,SU H G.Method of Line-Drawing Generation Based on Wavelet Multiresolution Analysis[J].Computer Engineering &Design,2010,31(17):3848-3851.(in Chinese)罗光蕊,苏鸿根.基于小波多分辨率分析的线条画生成方法[J].计算机工程与设计,2010,31(17):3848-3851.
[31] HU G W,WEI F.Intelligent Clean Line Drawing[C]∥International Conference on Robots & Intelligent System.Washington,DC,USA:IEEE,2016:217-220.
[32] TSAI H C,LEE Y H,LEE R R,et al.User-Guided Line Abstraction Using Coherence and Structure Analysis[J].Computational Visual Media,2017,3(2):1-12.
[33] COLE F,GOLOVINSKIY A,LIMPAECHER A,et al.Where Do People Draw Lines?[J].ACM Transactions on Graphics,2008,27(3):1-11.
[34] MINEAR M,PARK D C.A Lifespan Database of Adult Facial Stimuli[J].Behavior Research Methods,Instruments,& Computers,2004,36(4):630-633.
[35] ZHANG Y,DONG W M,MA C,et al.Data-Driven Synthesis of Cartoon Faces Using Different Styles[J].IEEE Transactions on Image Processing,2017,26(1):464-478.
[36] BEN-ZVI N,BENTO J,MAHLER M,et al.Line-Drawing Video Stylization[J].Computer Graphics Forum,2016,35(6):18-32.
[37] RUSINKIEWICZ S,COLE F,DECAROL D,et al.Line Dra- wings from 3D Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2008:1-3.
[38] SAITO T,TAKAHASHI T.Comprehensible Rendering of 3-D Shapes[J].Computer Graphics,1990,24(4):197-206.
[39] HERTAMZNN A.Introduction to 3D Non-Photorealistic Rendering:Silhouettes and Outlines[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:1-14.
[40] LOVISCACH J.Rendering Artistic Line Drawings Using Off-the-Shelf 3-D Software[C]∥Eurographics.Washington,DC,USA:IEEE,2002:125-130.
[41] RASKAR R,TAN K H,FERIS R,et al.Non-Photorealistic Camera:Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2004:679-688.
[42] LEE Y,LEE S,MARKOSIAN L,et al.Line Drawings via Abstracted Shading[J].ACM Transactions on Graphics,2007,26(3):18-23.
[43] BUCHANAN J W,SOUSA M C.The Edge Buffer:A Data Structure for Easy Silhouette Rendering[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2000:39-42.
[44] LIU J,ZHOU M Q,GENG G H,et al.Drawing Method of Cultural Line Map Based on Visual Curvature Estimation[J].Journal of Computer Science,2017,44(S2):244-250.(in Chinese)刘军,周明全,耿国华,等.基于视觉曲率估算的文物线图绘制方法[J].计算机科学,2017,44(S2):244-250.
[45] MCGUIRE M,HUGHES J F.Hardware-Determined Feature Edges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2004:35-47.
[46] SANDER P V,GU X F,HOPPE H,et al.Silhouette Clipping[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2000:327-334.
[47] GOOCH B,SLOAN P P J,GOOCH A,et al.Interactive Technical Illustration[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:31-38.
[48] BENICHOU F,ELBER G.Output Sensitive Extraction of Silhouettes From Polygonal Geometry[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,1999:60-70.
[49] HERTZMANN A,ZORIN D.Illustrating Smooth Surfaces[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,2000:517-526.
[50] BUCHHOLZ H,DOLLNER J,NIENHAUS M,et al.Real-Time Non-Photorealistic Rendering of 3D City Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2005:83-88.
[51] DECAROL D,FINKELSTEIN A,RUSINKIEWICZ S,et al. Suggestive Contours for Conveying Shape[J].ACM Transactions on Graphics,2003,22(3):848-855.
[52] OHTAKE Y,BELYAEV A,SEIDEL H P.Ridge-Valley Lines on Meshes via Implicit Surface Fitting[J].ACM Transactions on Graphics,2004,23(3):609-612.
[53] JUDD T,DURAND F,ADELSON E.Apparent Ridges for Line Drawing[J].ACM Transactions on Graphics,2007,26(3):19-26.
[54] DECAROL D,RUSINKIEWICZ S.Highlight Lines for Conve- ying Shape[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:63-70.
[55] XIE X X,HE Y,TIAN F,et al.An Effective Illustrative Visua- lization Framework Based on Photic Extremum Lines (PELs)[J].IEEE Transactions on Visualization & Computer Graphics,2007,13(6):1328-1335.
[56] KOLOMENKIN M,SHIMSHONI I,TAL A.Demarcating Curves for Shape Illustration[J].ACM Transactions on Graphics,2008,27(5):1-9.
[57] COLE F,SANIK K,DECAROL D,et al.How Well do Line Drawings Depict Shape?[J].ACM Transactions on Graphics,2009,28(3):1-9.
[58] GRABLI S,TURQUIN E,et al.Programmable Rendering of Line Drawing from 3D Scenes[J].ACM Transactions on Graphics,2010,29(2):1-20.
[59] RASKAR R,COHEN M.Image Precision Silhouette Edges[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,1999:135-140.
[60] RASKAR R.Hardware Support for Non-Photorealistic Rende- ring[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2001:41-47.
[61] XU H,NGUYEN M X,YUAN X R,et al.Interactive Silhouette Rendering for Point-based Models[C]∥Eurographics.Wa-shington,DC,USA:IEEE,2008:13-18.
[62] ZHENG H D.Evaluation Method of Face Stylized Rendering [D].Jinan:Shandong University,2015.(in Chinese)郑海东.人脸风格化绘制评估方法[D].济南:山东大学,2015.
[63] SALSIN D H.Non-Photorealistic Animation & Rendering:7 Grand Challenges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2002.
[64] GOOCH B S,GOOCH A A,JI L,et al.Viewing Progress in Non-Photorealistic Rendering Through Heinlein’s Lens[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:165-171.
[65] HERTAMANN A.Non-Photorealistic Rendering and the Science of Art[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:147-157.
[66] GOODWIN T,VOLLICK I,HERTZMANN A.Isophote Dis- tance:A Shading Approach to Artistic Stroke Thickness[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:53-62.
[1] WANG Xin, MENG Hao-hao, JIANG Xiao-tao, CHEN Sheng-yong, SUN Ling-yun. Survey on Character Motion Synthesis Based on Neural Network [J]. Computer Science, 2019, 46(9): 22-27.
[2] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
[3] LI Yin-min, XUE Kai-xin, GAO Zan, XUE Yan-bin, XU Guang-ping, ZHANG Hua. 3-D Model Retrieval Algorithm Based on Residual Network [J]. Computer Science, 2019, 46(3): 148-153.
[4] ZHOU Ming,JIA Yan-ming,ZHOU Cai-lan,XU Ning. English Automated Essay Scoring Methods Based on Discourse Structure [J]. Computer Science, 2019, 46(3): 234-241.
[5] LIU Hong-lin, SHUAI Ren-jun. Method of Fast Neural Style Transfer with Spatial Constraint [J]. Computer Science, 2019, 46(3): 283-286.
[6] LIU Zhi, LI Jiang-chuan. 3D Model Retrieval Based on Deep Convolution Neural Network [J]. Computer Science, 2019, 46(1): 278-284.
[7] LI Zhi-guo, ZHONG Jiang. Application of Data Science in Management Science Study:State-of-the-art in Domestic [J]. Computer Science, 2018, 45(9): 38-45.
[8] ZHANG Xiao-hua, HUANG Bo. 3D Geometric Reconstruction Based on Bayes-MeTiS Mesh Partition [J]. Computer Science, 2018, 45(6): 265-269,295.
[9] CHEN Wei-xu, CHEN Jian-ping, WEN Wan-zhi, CAI Liang. New Method for Webpage Watermarking Based on Empty Styles [J]. Computer Science, 2018, 45(11A): 338-341.
[10] LIU Zhi, PAN Xiao-bin. 3D Model Retrieval Method Based on Angle Structure Feature of Render Image [J]. Computer Science, 2018, 45(11A): 251-255.
[11] CHAO Le-men, XING Chun-xiao and ZHANG Yong. Data Science Studies:State-of-the-art and Trends [J]. Computer Science, 2018, 45(1): 1-13.
[12] ZHANG Ni, CHE Li-zhi and WU Xiao-jin. Present Situation and Prospect of Data-driven Based Fault Diagnosis Technique [J]. Computer Science, 2017, 44(Z6): 37-42.
[13] LIU Jun, ZHOU Ming-quan, GENG Guo-hua and SHEN Ying-quan. Drawing Method of Cultural Relics Line Drawing Based on Visual Curvature Estimation [J]. Computer Science, 2017, 44(Z11): 244-250.
[14] ZHOU Yan, ZENG Fan-zhi and YANG Yue-wu. 3D Model Retrieval Algorithm Based on Multi Feature Fusion [J]. Computer Science, 2016, 43(7): 303-309.
[15] LI Ning, GAO Xiao-guang, HOU Xia, ZHANG Wei and TIAN Ying-ai. Research on Parallel Transform of XML Data Based on XSLT Stylesheet Partitioning [J]. Computer Science, 2016, 43(3): 231-237.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[2] XIA Qing-xun and ZHUANG Yi. Remote Attestation Mechanism Based on Locality Principle[J]. Computer Science, 2018, 45(4): 148 -151, 162 .
[3] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[4] WANG Huan, ZHANG Yun-feng and ZHANG Yan. Rapid Decision Method for Repairing Sequence Based on CFDs[J]. Computer Science, 2018, 45(3): 311 -316 .
[5] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[6] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[7] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics[J]. Computer Science, 2018, 45(4): 169 -172 .
[8] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99, 116 .
[9] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[10] TONG Ze-ping, LI Tao, LI Li-jie and REN Liang. Study on Collaborative Optimization of Supply Chain with Uncertain Demand and Capacity Constraint[J]. Computer Science, 2018, 45(4): 260 -265 .