Computer Science ›› 2014, Vol. 41 ›› Issue (3): 88-90.

Previous Articles     Next Articles

Research on Parallel Chinese Syntactic Analysis Based on Hadoop Platform

LIU Sheng-jiu,LI Tian-rui,JIA Zhen and ZHU Jie   

  • Online:2018-11-14 Published:2018-11-14

Abstract: As one of research focuses of natural language processing,syntactic analysis has received much attention.Aiming at low efficiency and mediocre accuracy of current syntactic analysis methods,we investigated a parallel method of Chinese syntactic analysis on the cloud computing platform with the advantage of the computing power of cloud computing.We realized the parallel Chinese syntactic analysis on the built Hadoop cloud computing test platform with open corpus and source parser.Both experimental results and theoretical analysis confirm the feasibility,effectiveness and stability of the proposed method of parallel parsing based on Hadoop platform.

Key words: Cloud computing,Hadoop,Parallellism,Syntactic analysis

[1] 姚天顺,朱靖波,张琍,等.自然语言理解——一种让机器懂得人类语言的研究(第2版)[M].北京:清华大学出版社,2002
[2] 俞鸿魁,张华平,刘群,等.基于层叠隐马尔可夫模型的中文命名实体识别[J].通信学报,2006,27(2):87-94
[3] 曹勇刚,曹羽中,金茂忠,等.面向信息检索的自适应中文分词系统[J].软件学报,2006,17(3):356-363
[4] 刘挺,马金山.汉语自动句法分析的理论与方法[J].当代语言学,2009,11(2):100-112
[5] Mark A.Paskin,Cubic-time Parsing and Learning Algorithms for Grammatical Bigram Models [R].Technique report,2001
[6] 熊德意,刘群,林守勋.融合丰富语言知识的汉语统计句法分析[J].中文信息学报,2005,19(3):61-66
[7] 李正华,车万翔,刘挺.基于柱状搜索的高阶依存句法分析[J].中文信息学报,2010,24(1):37-41
[8] Harper M P,Huang Zhong-qiang.Chinese Statistical Parsing[M]∥Joseph Olive,John McCary,Caitlin Christianson,eds.Handbook of Natural Language Processing and Machine Translation.Reston Virginia,Defense Research Projects Agency,2011:90-102
[9] 代印唐,吴承荣,马胜祥,等.层级分类概率句法分析[J].软件学报,2011,22(2):245-257
[10] 陈功,罗森林,陈开江,等.结合结构下文及词汇信息的汉语句法分析方法[J].中文信息学报,2012,26(1):9-15
[11] Bizera C,Lehmannb J,Kobilarova G,et al.DBpedia-A Crystallization Point for the Web of Data [C]∥Proceedings of Web Semantics:Science,Services and Agents on the World Wide Web.2009:154-165
[12] 罗军舟,金嘉晖,宋爱波,等.云计算:体系架构与关键技术[J].通信学报,2011,32(7):3-21
[13] 于戈,谷峪,鲍玉斌,等.云计算环境下的大规模图数据处理技术[J].计算机学报,2011,34(10):1753-1767
[14] Bahga A,Madisetti V K.Analyzing Massive Machine Maintenance Data in a Computing Cloud [J].IEEE Transactions on Parallel and Distributed Systems,2012,23(10):1831-1843
[15] 李锐,王斌.文本处理中的MapReduce技术 [J].中文信息学报,2012,26(4):9-20
[16] 宁可为,王炜,李园伟.基于Hadoop的句群相似度计算 [J].计算机系统应用,2010,19(12):59-63
[17] http://www-nlp.stanford.edu/software/lex-parser.shtml[EB/OL]

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!