Computer Science ›› 2021, Vol. 48 ›› Issue (11A): 136-141.doi: 10.11896/jsjkx.210100025

• Intelligent Computing • Previous Articles     Next Articles

End-to-End Chinese-Braille Automatic Conversion Based on Transformer

JIANG Qi1, SU Wei1, XIE Ying2, ZHOUHONG An-ping2, ZHANG Jiu-wen1, CAI Chuan1   

  1. 1 School of Information Science & Engineering,Lanzhou University,Lanzhou 730000,China
    2 China Braille Press,Beijing 100142,China
  • Online:2021-11-10 Published:2021-11-12
  • About author:JIANG Qi,born in 1995,postgraduate.His main research interests include natural language processing and Chinese-Braille conversion technology.
    SU Wei,born in 1977,associate professor.His main research interests include natural language processing and information accessibility technology.
  • Supported by:
    National Natural Science Foundation of China(61772006),Research Program of China Disabled Persons' Federation and China Association of the Blind((14)0218),Guangxi Province Science and Technology Project(AA17204096,AB17129012) and Fund for Guangxi Province “Baguischolars”.

Abstract: Chinese-Braille automatic conversion concerns the life and learning of 17 million visually impaired people in China and the national information accessibility construction.All existing Chinese-Braille conversion methods adopt multi-step process,which firstly segment Chinese text according to Braille word segmentation rules,then mark tone for Chinese characters.This paper studies end-to-end deep learning system that directly converts Chinese into Braille.The encoder-decoder model transformer is trained on Chinese-Braille corpus.Based on six-month data of People's Daily,totaling about 12 million characters,this paper builds three Chinese-Braille corpora of Chinese common Braille,current Braille and Chinese double-phonic Braille systems.The experimental results show that the method proposed in this paper can convert Chinese into Braille in one step,and reaches BLEU score of 80.25%,79.08% and 79.29% in Chinese common Braille,current Braille and Chinese double-phonic Braille.Compared with the existing methods,this method requires a corpus which is less difficult to construct and the engineering complexity is lower.

Key words: Chinese-braille conversion, Encoder-decoder model, End-to-end deep learning, Transformer

CLC Number: 

  • TP391
[1]GB/T 15720-2008中国盲文[S].北京,2008.
[2]GF 0019-2018国家通用盲文方案[S].北京,2018.
[3]ZHONG J H.Analysis of the characteristics of Chinese common Braille Scheme[J].Modern Special Education,2018(23):23-25.
[4]GUO L H.Research on the current situation and development trend of Braille Publishing[J].Media Forum,2019,2(11):121-122.
[5]LI N.The current situation and trend of Braille Publishing[J].Modern Publishing,2016,(5):30-33.
[6]ZEGHIDOUR N,USUNIER N,SYNNAEVE G,et al.End-to-End speech recognition from the raw waveform[C]//Interspeech.2018:781-785.
[7]DABRE R,CHU C,KUNCHUKUTTAN A.A Survey of Multilingual Neural Machine Translation[J].ACM Computing Surveys,2020,53(5):1-38.
[8]SUTSKEVER I,VINYALS O,LE Q V.Sequence to sequence learning with neural networks[C]//Advancesin Neural Information Processing Systems.2014:3104-3112.
[9]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of Advances in Neural Information Processing Systems.2017:6000-6010.
[10]HUANG H Y,CHEN Z X,HUANG J.Chinese-Braille Translation Approach Based on Multi-Knowledge Analysis[C]//The 7th China Joint Conference on Computational Linguistics.2003:607-613.
[11]WANG X,YANG Y,LIU H,et al.Chinese-Braille translation based on Braille corpus[J].International Journal of Advanced Pervasive & Ubiquitous Computing,2016,8(2):56-63.
[12]WANG X,YANG Y,ZHANG J,et al.Chinese to Braille translation based on Braille word segmentation using statistical model[J].Journal of Shanghai Jiaotong University(Science),2017,22(1):82-86.
[13]LI Z,WANG R,ZHANG T,et al.Intelligent Braille conversion system of Chinese characters based on Markov model[C]//Proceedings of IEEE 3rd Information Technology,Networking,Electronic and Automation Control Conference(ITNEC).2019:1283-1287.
[14]CAI J,WANG X D,TANG L Z,et al.A Deep Learning Method for Chinese-Braille Conversion Based on Parallel Corpora[J].Journal of Chinese Information Processing,2019,33(4):60-67.
[15]MA J,GANCHEV K,WEISS D.State-of-the-art Chinese word segmentation with BiLSTMs[C]//The 2018 Conference on Empirical Methods in Natural Language Processing.2018:4902-4908.
[16]PAPINENI K,ROUKOS S,WARD T,et al.BLEU:a method for automatic evaluation of machine translation[C]//ACL.2002:311-318.
[17]GAMBHIR M,GUPTA V.Recent automatic text summarization techniques:a survey[J].Artificial Intelligence Review,2017,47(1):1-66.
[18]KOEHN P,KNOWLES R.Six challenges for neural machine translation[C]//The First Workshop on Neural Machine Translation.2017:28-39.
[19]YANG S H,WANG Y X,CHU X W.A Survey of Deep Learning Techniques for Neural Machine Translation[J].arXiv:2002.07526,2020.
[1] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[2] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[3] KANG Yan, XU Yu-long, KOU Yong-qi, XIE Si-yu, YANG Xue-kun, LI Hao. Drug-Drug Interaction Prediction Based on Transformer and LSTM [J]. Computer Science, 2022, 49(6A): 17-21.
[4] ZHAO Xiao-hu, YE Sheng, LI Xiao. Multi-algorithm Fusion Behavior Classification Method for Body Bone Information Reconstruction [J]. Computer Science, 2022, 49(6): 269-275.
[5] LU Liang, KONG Fang. Dialogue-based Entity Relation Extraction with Knowledge [J]. Computer Science, 2022, 49(5): 200-205.
[6] YANG Hui-min, MA Ting-huai. Compound Conversation Model Combining Retrieval and Generation [J]. Computer Science, 2021, 48(8): 234-239.
[7] YANG Jin-cai, CAO Yuan, HU Quan, SHEN Xian-jun. Relation Classification of Chinese Causal Compound Sentences Based on Transformer Model and Relational Word Feature [J]. Computer Science, 2021, 48(6A): 295-298.
[8] HUO Shuai, PANG Chun-jiang. Research on Sentiment Analysis Based on Transformer and Multi-channel Convolutional Neural Network [J]. Computer Science, 2021, 48(6A): 349-356.
[9] QIU Jia-zuo, XIONG De-yi. Frontiers in Neural Question Generation:A Literature Review [J]. Computer Science, 2021, 48(6): 159-167.
[10] LI Feng and XIA Li. Transformer Fault Monitoring Expert System Based on Rule Base [J]. Computer Science, 2016, 43(Z11): 564-567.
[11] . [J]. Computer Science, 2008, 35(7): 157-160.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!