风格线条画生成技术综述

doi:10.11896/j.issn.1002-137X.2019.07.003

摘要/Abstract

摘要： 线条画作为一种简单而有效的视觉传达手段,通过突出主要的细节特征,使得人们可以快速地获得主要信息;同时,风格线条画作为一种艺术形式,让人们能够快速欣赏和理解其艺术特征。文中对线条画的生成方法进行了综述与分析。线条画生成技术可以分为基于2D图像的方法与基于3D模型的方法。其中,基于2D图像的线条画生成技术包括样本学习方法、非样本学习的数据驱动方法与非数据驱动方法;基于3D模型的线条画生成技术包括图像空间方法、对象空间方法以及两者的混合方法。通过介绍与分析各种方法并对比分析其优缺点,总结了线条画生成技术现阶段存在的问题及其可能的解决方案,并在此基础上对线条画生成的未来发展趋势进行了展望。

关键词: 2D图像, 3D模型, 风格, 数据驱动, 线条画, 样本学习

Abstract: Line drawing has a great advantage in the transmission of visual information.As a simple and effective means of visual communication,it stresses main features of the details so that people can get the main information quickly.At the same time,stylized line drawing,as an art form,enables people to appreciate and understand their artistic characte-ristics quickly.Line drawing generation technology can be divided into 2D image-based methods and 3D image-based methods.Line drawing generation technology based on 2D images includes deep learning method and traditional me-thod,which contains data drive method and non-data-driven method.Line drawing generation technology based on 3D model contains image space method,object space method and their blending method.By introducing and analyzing va-rious methods and analyzing the advantages and disadvantages of different methods with comparisons among them,this paper summarized the existing problems of line drawing generation technology and their possible solutions.And on this basis,the future development trend of line painting was prospected.

Key words: 2D image, 3D model, Data-driven, Example-based, Line drawing, Style

中图分类号:

TP391

刘子奇, 刘世光. 风格线条画生成技术综述[J]. 计算机科学, 2019, 46(7): 13-21. https://doi.org/10.11896/j.issn.1002-137X.2019.07.003

LIU Zi-qi, LIU Shi-guang. Summary of Stylized Line Drawing Generation[J]. Computer Science, 2019, 46(7): 13-21. https://doi.org/10.11896/j.issn.1002-137X.2019.07.003

参考文献

[1]KANG H,LEE S,CHUI C K.Coherent Line Drawing[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:43-50.
[2]ISENBERG T,FREUDENBERG B,HALPER N,et al.A Developer’s Guide to Silhouette Algorithms for Polygonal Models[J].IEEE Computer Graphics & Applications,2003,23(4):28-37.
[3]BERGER I,SHAMIR A,MAHLER M,et al.Style and Abstrac- tion in Portrait Sketching[J].ACM Transactions on Graphics,2013,32(4):1-12.
[4]CHEN H,ZHENG N N,XU Y Q,et al.Image Line Drawing Generation System Based on Sample Learning[J].Journal of Software,2003,14(2):202-208.(in Chinese)
陈洪,郑南宁,徐迎庆,等.基于样本学习的人像线条画生成系统[J].软件学报,2003,14(2):202-208.
[5]SONG Y B,BAO L C,YANG Q X,et al.Real-Time Exemplar-Based Face Sketch Synthesis[C]∥European Conference on Computer Vision.Berlin Heidelberg:Springer,2014:800-813.
[6]WANG N N,ZHANG S C,GAO X B,et al.Unified Framework for Face Sketch Synthesis[J].Signal Processing,2017,130:1-11.
[7]LIANG Y,SONG M,XIE L,et al.Face Sketch-to-Photo Synthesis from Simple Line Drawing[C]∥Signal & Information Processing Association Summit and Conference.Washington,DC,USA:IEEE,2012:1-5.
[8]WANG X,OXHOLM G,ZHANG D,et al.Multimodal Transfer:a Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer[C]∥Computer Vision and Pattern Re-cognition.Washington,DC,USA:IEEE,2017:7178-7186.
[9]GATYS L A,ECKER A S,BETHGE M.Image Style Transfer Using Convolutional Neural Networks[C]∥Computer Vision and Pattern Recognition.Washington,DC,USA:IEEE,2016:2414-2423.
[10]KAUR P,ZHANG H,DANA K J.Photo-Realistic Facial Texture Transfer[J].arXiv:1706.04306,2017.
[11]CANNY J.A Computational Approach to Edge Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1986,8(6):679-698.
[12]LINE F C,KANG M,LIN X.Improved Canny Edge Detection Algorithm[J].Journal of Computer Science,2016,43(8):309-312.(in Chinese)
凌凤彩,康牧,林晓.改进的Canny边缘检测算法[J].计算机科学,2016,43(8):309-312.
[13]DECARLO D,SANTELLA A.Stylization and Abstraction of Photographs[J].ACM Transactions on Graphics,2002,21(3):769-776.
[14]KANG H W,CHUI C K,CHAKRABORTY U K.A Unified Scheme for Adaptive Stroke-Based Rendering[M].New York:Springer-Verlag,2006:814-824.
[15]LI R L,LIANG Y,ZHANG S H.Cartoon Video Segmentation and Vectorization Based on Canny Optimization[J].Journal of Computer Science,2017,44(8):27-30.(in Chinese)
李瑞龙,梁缘,张松海.基于Canny优化的卡通视频分割与矢量化[J].计算机科学,2017,44(8):27-30.
[16]ORZAN A,BOUSSEAU A,BARLA P.Structure-Preserving Manipulation of Photographs[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:103-110.
[17]FISCHAR J,BARTZ D,STRABER W.Stylized Augmented Rea- lity for Improved Immersion[C]∥Virtual Reality.Washington,DC,USA:IEEE,2005:195-202.
[18]LIANG B,DAI F,ZHAO F Q.Images Line Drawings Generation by Edge Tracking Algorithm[J].Journal of Image & Graphics,2011,16(11):2074-2080.(in Chinese)
梁波,戴芳,赵凤群.边缘跟踪算法的图像线条画生成[J].中国图象图形学报,2011,16(11):2074-2080.
[19]GOOCH B,REINHARD E,GOOCH A.Human Facial Illustrations:Creation and Psychophysical Evaluation[J].ACM Tran-sactions on Graphics,2004,23(1):27-44.
[20]MARR D,HILDRESH E.Theory of Edge Detection[J].Proceedings of the Royal Society of London,1980,207(1167):187-217.
[21]WINNEMOLLER H,OLSEN S C,GOOCH B.Real-Time Video Abstraction[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2006:1221-1226.
[22]WINNEMOLLER H,KYPRIANIDIS J E,OLSEN S C.XDoG:An Extended Difference-of-Gaussians Compendium Including Advanced Image Stylization[J].Computers & Graphics,2012,36(6):740-753.
[23]ROSIN P L,LAI Y K.Artistic Minimal Rendering with Lines and Blocks[J].Graphical Models,2013,75(4):208-229.
[24]KANG H,LEE S,CHUI C K.Flow-Based Image Abstraction [J].IEEE Transactions on Visualization & Computer Graphics,2009,15(1):62-76.
[25]WANG S D,MA Z Y,LIU X H,et al.Coherence-Enhancing Line Drawing for Color Images[J].Science China Information Sciences,2013,56(11):1-11.
[26]WANG S D,WU E,LIU Y Q,et al.Abstract Line Drawings from Photographs Using Flow-Based Filters[J].Computers & Graphics,2014,36(4):224-231.
[27]WANG S D,LIU X H,CHEN Y Y,et al.Abstract Line Dra- wing Generation Based on Characteristic Flow[J].Journal of Computer Science,2014,37(3):611-620.(in Chinese)
王山东,刘学慧,陈彦云,等.基于特征流的抽象线条画绘制[J].计算机学报,2014,37(3):611-620.
[28]SON M,KANG H,LEE Y,et al.Abstract Line Drawings from 2D Images[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,2007:333-342.
[29]ZHAO J X,LI X H,CHONG F.Abstract Line Drawings from 2D Images Based on Thinning[C]∥Congress on Image and Signal Processing.Washington,DC,USA:IEEE,2008:466-470.
[30]LUO G R,SU H G.Method of Line-Drawing Generation Based on Wavelet Multiresolution Analysis[J].Computer Engineering &Design,2010,31(17):3848-3851.(in Chinese)
罗光蕊,苏鸿根.基于小波多分辨率分析的线条画生成方法[J].计算机工程与设计,2010,31(17):3848-3851.
[31]HU G W,WEI F.Intelligent Clean Line Drawing[C]∥International Conference on Robots & Intelligent System.Washington,DC,USA:IEEE,2016:217-220.
[32]TSAI H C,LEE Y H,LEE R R,et al.User-Guided Line Abstraction Using Coherence and Structure Analysis[J].Computational Visual Media,2017,3(2):1-12.
[33]COLE F,GOLOVINSKIY A,LIMPAECHER A,et al.Where Do People Draw Lines?[J].ACM Transactions on Graphics,2008,27(3):1-11.
[34]MINEAR M,PARK D C.A Lifespan Database of Adult Facial Stimuli[J].Behavior Research Methods,Instruments,& Computers,2004,36(4):630-633.
[35]ZHANG Y,DONG W M,MA C,et al.Data-Driven Synthesis of Cartoon Faces Using Different Styles[J].IEEE Transactions on Image Processing,2017,26(1):464-478.
[36]BEN-ZVI N,BENTO J,MAHLER M,et al.Line-Drawing Video Stylization[J].Computer Graphics Forum,2016,35(6):18-32.
[37]RUSINKIEWICZ S,COLE F,DECAROL D,et al.Line Dra- wings from 3D Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2008:1-3.
[38]SAITO T,TAKAHASHI T.Comprehensible Rendering of 3-D Shapes[J].Computer Graphics,1990,24(4):197-206.
[39]HERTAMZNN A.Introduction to 3D Non-Photorealistic Rendering:Silhouettes and Outlines[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:1-14.
[40]LOVISCACH J.Rendering Artistic Line Drawings Using Off-the-Shelf 3-D Software[C]∥Eurographics.Washington,DC,USA:IEEE,2002:125-130.
[41]RASKAR R,TAN K H,FERIS R,et al.Non-Photorealistic Camera:Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2004:679-688.
[42]LEE Y,LEE S,MARKOSIAN L,et al.Line Drawings via Abstracted Shading[J].ACM Transactions on Graphics,2007,26(3):18-23.
[43]BUCHANAN J W,SOUSA M C.The Edge Buffer:A Data Structure for Easy Silhouette Rendering[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2000:39-42.
[44]LIU J,ZHOU M Q,GENG G H,et al.Drawing Method of Cultural Line Map Based on Visual Curvature Estimation[J].Journal of Computer Science,2017,44(S2):244-250.(in Chinese)
刘军,周明全,耿国华,等.基于视觉曲率估算的文物线图绘制方法[J].计算机科学,2017,44(S2):244-250.
[45]MCGUIRE M,HUGHES J F.Hardware-Determined Feature Edges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2004:35-47.
[46]SANDER P V,GU X F,HOPPE H,et al.Silhouette Clipping[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2000:327-334.
[47]GOOCH B,SLOAN P P J,GOOCH A,et al.Interactive Technical Illustration[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,1999:31-38.
[48]BENICHOU F,ELBER G.Output Sensitive Extraction of Silhouettes From Polygonal Geometry[C]∥Pacific Conference on Computer Graphics and Applications.Washington,DC,USA:IEEE,1999:60-70.
[49]HERTZMANN A,ZORIN D.Illustrating Smooth Surfaces[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,2000:517-526.
[50]BUCHHOLZ H,DOLLNER J,NIENHAUS M,et al.Real-Time Non-Photorealistic Rendering of 3D City Models[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2005:83-88.
[51]DECAROL D,FINKELSTEIN A,RUSINKIEWICZ S,et al. Suggestive Contours for Conveying Shape[J].ACM Transactions on Graphics,2003,22(3):848-855.
[52]OHTAKE Y,BELYAEV A,SEIDEL H P.Ridge-Valley Lines on Meshes via Implicit Surface Fitting[J].ACM Transactions on Graphics,2004,23(3):609-612.
[53]JUDD T,DURAND F,ADELSON E.Apparent Ridges for Line Drawing[J].ACM Transactions on Graphics,2007,26(3):19-26.
[54]DECAROL D,RUSINKIEWICZ S.Highlight Lines for Conve- ying Shape[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:63-70.
[55]XIE X X,HE Y,TIAN F,et al.An Effective Illustrative Visua- lization Framework Based on Photic Extremum Lines (PELs)[J].IEEE Transactions on Visualization & Computer Graphics,2007,13(6):1328-1335.
[56]KOLOMENKIN M,SHIMSHONI I,TAL A.Demarcating Curves for Shape Illustration[J].ACM Transactions on Graphics,2008,27(5):1-9.
[57]COLE F,SANIK K,DECAROL D,et al.How Well do Line Drawings Depict Shape?[J].ACM Transactions on Graphics,2009,28(3):1-9.
[58]GRABLI S,TURQUIN E,et al.Programmable Rendering of Line Drawing from 3D Scenes[J].ACM Transactions on Graphics,2010,29(2):1-20.
[59]RASKAR R,COHEN M.Image Precision Silhouette Edges[C]∥ ACM SIGGRAPH.New York,NY,USA:ACM,1999:135-140.
[60]RASKAR R.Hardware Support for Non-Photorealistic Rende- ring[C]∥ACM SIGGRAPH.New York,NY,USA:ACM,2001:41-47.
[61]XU H,NGUYEN M X,YUAN X R,et al.Interactive Silhouette Rendering for Point-based Models[C]∥Eurographics.Wa-shington,DC,USA:IEEE,2008:13-18.
[62]ZHENG H D.Evaluation Method of Face Stylized Rendering [D].Jinan:Shandong University,2015.(in Chinese)
郑海东.人脸风格化绘制评估方法[D].济南:山东大学,2015.
[63]SALSIN D H.Non-Photorealistic Animation & Rendering:7 Grand Challenges[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2002.
[64]GOOCH B S,GOOCH A A,JI L,et al.Viewing Progress in Non-Photorealistic Rendering Through Heinlein’s Lens[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:165-171.
[65]HERTAMANN A.Non-Photorealistic Rendering and the Science of Art[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2010:147-157.
[66]GOODWIN T,VOLLICK I,HERTZMANN A.Isophote Dis- tance:A Shading Approach to Artistic Stroke Thickness[C]∥International Symposium on Non-Photorealistic Animation and Rendering.New York,NY,USA:ACM,2007:53-62.

相关文章 15

[1]	张颖涛, 张杰, 张睿, 张文强. 全局信息引导的真实图像风格迁移 Photorealistic Style Transfer Guided by Global Information 计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[2]	刘畅, 魏为民, 孟繁星, 才智. 语音风格迁移研究进展 Research Progress on Speech Style Transfer 计算机科学, 2022, 49(6A): 301-308. https://doi.org/10.11896/jsjkx.210300134
[3]	杨玥, 冯涛, 梁虹, 杨扬. 融合交叉注意力机制的图像任意风格迁移 Image Arbitrary Style Transfer via Criss-cross Attention 计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[4]	陈章辉, 熊贇. 基于解耦-检索-生成的图像风格化描述生成模型 Stylized Image Captioning Model Based on Disentangle-Retrieve-Generate 计算机科学, 2022, 49(6): 180-186. https://doi.org/10.11896/jsjkx.211100129
[5]	彭云聪, 秦小林, 张力戈, 顾勇翔. 面向图像分类的小样本学习算法综述 Survey on Few-shot Learning Algorithms for Image Classification 计算机科学, 2022, 49(5): 1-9. https://doi.org/10.11896/jsjkx.210500128
[6]	方仲礼, 王喆, 迟子秋. 面向多标签小样本学习的双流重构网络 Dual-stream Reconstruction Network for Multi-label and Few-shot Learning 计算机科学, 2022, 49(1): 212-218. https://doi.org/10.11896/jsjkx.201100143
[7]	宁秋怡, 史小静, 段湘煜, 张民. 基于风格感知的无监督领域适应算法 Unsupervised Domain Adaptation Based on Style Aware 计算机科学, 2022, 49(1): 271-278. https://doi.org/10.11896/jsjkx.201200094
[8]	叶洪良, 朱皖宁, 洪蕾. 基于CQT和梅尔频谱的带有人声的音乐风格转换方法 Music Style Transfer Method with Human Voice Based on CQT and Mel-spectrum 计算机科学, 2021, 48(6A): 326-330. https://doi.org/10.11896/jsjkx.200900104
[9]	郭杰, 高希然, 陈莉, 傅游, 刘颖. 用数据驱动的编程模型并行多重网格应用 Parallelizing Multigrid Application Using Data-driven Programming Model 计算机科学, 2020, 47(8): 32-40. https://doi.org/10.11896/jsjkx.200500093
[10]	汪航, 陈晓, 田晟兆, 陈端兵. 基于小样本学习的SAR图像识别 SAR Image Recognition Based on Few-shot Learning 计算机科学, 2020, 47(5): 124-128. https://doi.org/10.11896/jsjkx.190400136
[11]	张美玉, 刘跃辉, 秦绪佳, 吴良武. 基于拉普拉斯算子抑制伪影的神经风格迁移方法 Neural Style Transfer Method Based on Laplace Operator to Suppress Artifacts 计算机科学, 2020, 47(11A): 209-214. https://doi.org/10.11896/jsjkx.200100090
[12]	缪永伟, 李高怡, 鲍陈, 张旭东, 彭思龙. 基于卷积神经网络的图像局部风格迁移 Image Localized Style Transfer Based on Convolutional Neural Network 计算机科学, 2019, 46(9): 259-264. https://doi.org/10.11896/j.issn.1002-137X.2019.09.039
[13]	王鑫, 孟浩浩, 姜小涛, 陈胜勇, 孙凌云. 基于神经网络的角色运动合成研究进展 Survey on Character Motion Synthesis Based on Neural Network 计算机科学, 2019, 46(9): 22-27. https://doi.org/10.11896/j.issn.1002-137X.2019.09.003
[14]	刘洪麟,帅仁俊. 一种具有空间约束的快速神经风格迁移方法 Method of Fast Neural Style Transfer with Spatial Constraint 计算机科学, 2019, 46(3): 283-286. https://doi.org/10.11896/j.issn.1002-137X.2019.03.042
[15]	李荫民, 薛凯心, 高赞, 薛彦兵, 徐光平, 张桦. 基于残差网络的三维模型检索算法 3-D Model Retrieval Algorithm Based on Residual Network 计算机科学, 2019, 46(3): 148-153. https://doi.org/10.11896/j.issn.1002-137X.2019.03.022

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed