Computer Science ›› 2019, Vol. 46 ›› Issue (11A): 264-267.

• Pattern Recognition & Image Processing • Previous Articles     Next Articles

Handwritten Drawing Order Recovery Method Based on Endpoint Sequential Prediction

ZHANG Rui1, ZHAN Yong-song2, YANG Ming-hao3   

  1. (Guangxi Experiment Center of Information Science,Guilin University of Electronic Technology,Guilin,Guangxi 541004,China)1;
    (Guangxi Key Laboratory of Trusted Software,Guilin University of Electronic Technology,Guilin,Guangxi 541004,China)2;
    (The National Laboratory of Pattern Recognition,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China)3
  • Online:2019-11-10 Published:2019-11-20

Abstract: To address the problem of dynamic sequential recovery for Chinese handwritten,a handwritten drawing order recovery model based on deep learning method was designed.First,the handwritten image is preprocessed by coordinate regularization,refinement,and interruption of intersections,then the preprocessed image and the corresponding written coordinate sequence are used to generate the sample of the network.The sample consists of a static handwritten image and a heat map label containing the font writing order.The model uses an end-to-end convolutional neural work.Finally,the trained network model is used to predict the static handwritten image to get the original writing order of the font.The experimental results show that the method can effectively recovery the drawing order of handwritten fonts that less than five strokes.

Key words: Convolutional neural networks, Deep learning, Handwriting, Order recovery, Time series information

CLC Number: 

  • TP183
[1]金连文,钟卓耀,杨钊,等.深度学习在手写汉字识别中的应用综述[J].自动化学报,2016,42(8):1125-1141.
[2]CORDELLA L P,STEFANO C D,MARCELLI A,et al.Writing Order Recovery from Off-Line Handwriting by Graph Traversal[J].IEEE International Conference on Pattern Recognition 2010:1896-1899.
[3]DINH M,YANG H J,LEE G S,et al.Recovery of drawing order from multi-stroke English handwritten images based on graph models and ambiguous zone analysis[J].Expert Systems with Applications,2016(64):352-364.
[4]LEMAIGNAN S,JACQ A,Hood D,et al.Learning by Teaching a Robot:The Case of Handwriting[J].IEEE Robotics & Automation Magazine,2016,23(2):56-66.
[5]YANG M H,ZHANG K,ZHAO BQ,et al.A Robotic Writing System with Intelligent Interactive Learning Ability[C]∥CHCI2017,2017.
[6]QIAO Y,NISHIARA M,YASUHARA M.A framework to-ward restoration of writing order from single-stroked handwriting image[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2006(28):1724-1737.
[7]BOCCIGNONE G,CHIANESE A,CORDELLA L P,et al.Recovering dynamic information from static handwriting[J].Pattern Recognition,1993,26(3):409-418.
[8]QIAO Y,YASUHARA M.Recovering Drawing Order from Offline Handwritten Image Using Direction Context and Optimal Euler Path[C]∥IEEE International Conference on Acoustics,Speech and Signal Processing.2006:II-II.
[9]NAGOYA T,FUJIOKA H.Recovering Human-Like Drawing Order from Static Handwritten Images with Double-Traced Lines[J].Lecture Notes in Electrical Engineering,2013(253):941-948.
[10]NGUYEN V,BLUMENSTEIN M.Techniques for static handwriting trajectory recovery:a survey[J].International Workshop on Document Analysis Systems,2010:463-470.
[11]曹忠升,苏哲文,王元珍.一种脱机手写汉字书写顺序恢复模型[J].中国图象图形学报,2009,14(10):2074-2081.
[12]SHARMA A.Recovery of drawing order in handwritten digit images[C]∥IEEE Second International Conference on Image Information Processing.IEEE,2014:437-441.
[13]NAKAI M,SHIMODAIRA H,SAGAYAMA S.Generation of hierarchical dictionary for stroke-order free Kanji handwriting recognition based on substroke HMM[C]∥International Conference on Document Analysis and Recognition.IEEE,2003(1):514-518.
[14]ZHANG X Y,YIN F,ZHANG Y M,et al.Drawing and Recognizing Chinese Characters with Recurrent Neural Network[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2018(99):1-1.
[15]BHUNIA A K,BHOWMICK A,BHUNIA A K,et al.Handwriting Trajectory Recovery using End-to-End Deep Encoder-Decoder Network[C]∥2018 24th International Conference on Pattern Recognition (ICPR).Beijing,China:IEEE,2018.
[16]LECUN Y L,BOTTOU L,BENGIO Y,et al.Gradient- Based Learning Applied to Document Recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[17]HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]∥Proceedings of the IEEE conference on Computer Vision and Pattern Recognition.2016:770-778.
[18]LECUN Y,BOSER B E,DENKER J S,et al.Handwritten digit recognition with a back-propagation network[C]∥Advances in Neural Information Processing Systems.SanFrancisco,CA,USA,1990:396-404.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[3] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[8] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[9] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[10] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[11] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[12] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[13] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[14] ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[15] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!