Computer Science ›› 2018, Vol. 45 ›› Issue (11A): 198-202.

• Pattem Recognition & Image Processing • Previous Articles     Next Articles

Sequential Feature Based Sketch Recognition

YU Mei-yu, WU Hao, GUO Xiao-yan, JIA Qi GUO He   

  1. School of Software Technology,Dalian University of Technology,Dalian,Liaoning 116621,China
  • Online:2019-02-26 Published:2019-02-26

Abstract: Recognizing freehand sketches is a greatly challenging work.Most existing methods treat sketches as traditional texture images with fixed structural ordering and ignore the temporality of sketch.In this paper,a novel sketch recognition method was proposed based on the sequence of sketch.Strokes are divided into groups and their features are fed into recurrent neural network to make use of the temporality.The features from each temporality are combined to produce the final classification results.The proposed algorithm was tested on a benchmark,and the recognition rate is far above other methods.

Key words: Gate recurrent units(GRU), Joint bayes, Recurrent neural network, Sketch recognition, Temporality

CLC Number: 

  • TP391
[1]EITZ M,HAYS J,ALEXA M.How do humans sketch object?[J].ACM Transactions on Graphics,2012,31(4):1-10.
[2]SCHNEIDER R G,TUYTELAARS T.Sketch classification and classification-driven analysis using fisher vectors[J].ACM Transactions on Graphics,2014,33(6):174.
[3]EITZ M,HILDEBRAND K,BOUBEKEUR T,et al.Sketch-based image retrieval:Benchmark and bag-of-featuresdescriptors[J].IEEE Transactions on Visualization and Computer Grap-hics,2011,17(11):1624-1636.
[4]HU R,COLLOMOSSE J.A performance evaluation of gradient field hog descriptor for sketch based image retrieval[J].Computer Vision and Image Understanding,2013,117(7):790-806.
[5]WANG F,KANG L,LI Y.Sketch-based 3d shape retrieval using convolutional neural network[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston,MA,USA:IEEE Press,2015:1875-1883.
[6]DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[C]∥2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.San Diego,CA,USA:IEEE Press,2005,1:886-893.
[7]LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[8]YU Q,YANG Y,SONG Y Z,et al.Sketch-a-net that beats humans[C]∥British Machine Vision Conference,BMVC 2015.Swansea,UK:BMVA Press,2015:1-12.
[9]LI Y,HOSPEDALES T M,SONG Y Z,et al.Free-hand sketch recognition by multi-kernel feature learning[J].Computer Vision and Image Understanding,2015,137:1-11.
[10]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Image net classification with deep convolutional neural networks[C]∥Advances in Neural Information Processing Systems.Lake Tahoe,Nevada,USA:IEEE Press,2012:1097-1105.
[11]王卫,尹建峰,孙正兴.一种手绘草图的快速参数化方法[J].计算机科学,2006,33(1):264-268.
[12]袁贞明,金贵朝,张佳.基于贝叶斯网络的在线草图识别算法[J].计算机工程,2010,36(5):32-34.
[13]尹建锋,孙正兴.基于时序的多笔划草图识别[J/OL].中国科技论文在线,http://www.paper.edu.cn/search/simple?searchType=&searchContent=%25E5%259F%25BA%25E4%25BA%258E%25E6%2597%25B6%25E5%25BA%258F%25E7%259A%2584%25E5%25A4%259A%25E7%25AC%2594%25
E5%2588%2592%25E8%258D%2589%25E5%259B%25BE%25E8%25AF%2586%25E5%2588%25AB&searchDate=2003-2018&searchPage=1&searchSub-ject=%25E5%2585%25A8%25E9%2583%25A8&searchSort=relevant.
[14]SIMONYAN K,ZISSERMAN A.Very deep convolutional net works for large-scale image recognition[J].arXivpreprint arXiv:1409.1556,2014.
[15]LECUN Y,BOSER B E,DENKER J S,et al.Handwritten digit recognition with a back-propagation network[C]∥Advances in Neural Information Processing Systems.Denver,Colorado,USA:Morgan Kaufmann,1990:396-404.
[16]WANG F,KANG L,LI Y.Sketch-based 3d shape retrieval using convolutional neural networks[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston,MA,USA:IEEE Computer Society,2015:1875-1883.
[17]VINYALS O,RAVURI S V,POVEY D.Revisiting recurrent neural networks for robust ASR[C]∥2012 IEEE International Conference on Acoustics,Speech and Signal Processing.Kyoto,Japan:IEEE Press,2012:4085-4088.
[18]SUTSKEVER I,MARTENS J,HINTON G E.Generating text with recurrent neural networks[C]∥Proceedings of the 28th International Conference on Machine Learning.Bellevue,Wa-shington,USA:MLR.org,2011:1017-1024.
[19]HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[20]CHO K,VAN MERRIËNBOER B,GULCEHRE C,et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]∥Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing,EMNLP 2014.Doha,Qatar:Association for Computational Linguistics,2014:1724-1734.
[21]CHUNG J,GULCEHRE C,CHO K,et al.Gated feedback recurrent neural networks[C]∥International Conference on Machine Learning.Lille,France:MLR.org,2015:2067-2075.
[22]CHEN D,CAO X,WANG L,et al.Bayesian face revisited:A joint formulation[C]∥12th European Conference on Computer Vision.Florence,Italy:Springer,2012:566-579.
[23]COLLOBERT R,BENGIO S,MARIÉTHOZ J.Torch:a modular machine learning software library[R].Idiap Research Report,2002.
[24]LI Y,SONG Y Z,GONG S.Sketch Recognition by Ensemble Matching of Structured Features[C]∥British Machine Vision Conference,BMVC 2013.Bristol,UK:BMVA Press,2013:2.
[25]YU Q,YANG Y,LIU F,et al.Sketch-a-net:A deep neural network that beats humans[J].International Journal of Computer Vision,2017,122(3):411-425.
[1] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[2] YU Xin, LIN Zhi-liang. Novel Neural Network for Dealing with a Kind of Non-smooth Pseudoconvex Optimization Problems [J]. Computer Science, 2022, 49(5): 227-234.
[3] AN Xin, DAI Zi-biao, LI Yang, SUN Xiao, REN Fu-ji. End-to-End Speech Synthesis Based on BERT [J]. Computer Science, 2022, 49(4): 221-226.
[4] SHI Yu-tao, SUN Xiao. Conversational Comprehension Model for Question Generation [J]. Computer Science, 2022, 49(3): 232-238.
[5] LI Hao, CAO Shu-yu, CHEN Ya-qing, ZHANG Min. User Trajectory Identification Model via Attention Mechanism [J]. Computer Science, 2022, 49(3): 308-312.
[6] XIAO Ding, ZHANG Yu-fan, JI Hou-ye. Electricity Theft Detection Based on Multi-head Attention Mechanism [J]. Computer Science, 2022, 49(1): 140-145.
[7] ZENG You-yu, XIE Qiang. Fault Prediction Method Based on Improved RNN and VAR for Ship Equipment [J]. Computer Science, 2021, 48(6): 184-189.
[8] WANG Xi, ZHANG Kai, LI Jun-hui, KONG Fang, ZHANG Yi-tian. Generation of Image Caption of Joint Self-attention and Recurrent Neural Network [J]. Computer Science, 2021, 48(4): 157-163.
[9] CHEN Qian, CHE Miao-miao, GUO Xin, WANG Su-ge. Recurrent Convolution Attention Model for Sentiment Classification [J]. Computer Science, 2021, 48(2): 245-249.
[10] LYU Ming-qi, HONG Zhao-xiong, CHEN Tie-ming. Traffic Flow Forecasting Method Combining Spatio-Temporal Correlations and Social Events [J]. Computer Science, 2021, 48(2): 264-270.
[11] LI Ya-nan, HU Yu-jia, GAN Wei, ZHU Min. Survey on Target Site Prediction of Human miRNA Based on Deep Learning [J]. Computer Science, 2021, 48(1): 209-216.
[12] ZHUANG Shi-jie, YU Zhi-yong, GUO Wen-zhong, HUANG Fang-wan. Short Term Load Forecasting via Zoneout-based Multi-time Scale Recurrent Neural Network [J]. Computer Science, 2020, 47(9): 105-109.
[13] YOU Lan, HAN Xue-wei, HE Zheng-wei, XIAO Si-yu, HE Du, PAN Xiao-meng. Improved Sequence-to-Sequence Model for Short-term Vessel Trajectory Prediction Using AIS Data Streams [J]. Computer Science, 2020, 47(9): 169-174.
[14] HE Lei, SHAO Zhan-peng, ZHANG Jian-hua and ZHOU Xiao-long. Review of Deep Learning-based Action Recognition Algorithms [J]. Computer Science, 2020, 47(6A): 139-147.
[15] ZHANG Zhi-yang, ZHANG Feng-li, CHEN Xue-qin, WANG Rui-jin. Information Cascade Prediction Model Based on Hierarchical Attention [J]. Computer Science, 2020, 47(6): 201-209.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!