计算机科学 ›› 2010, Vol. 37 ›› Issue (3): 6-10.
• 综述 • 上一篇 下一篇
张海军,史树敏,朱朝勇,黄河燕
出版日期:
发布日期:
基金资助:
ZHANG Hai-jun,SHI Shu-min,ZHU Chao-yong,HUANG He-yan
Online:
Published:
摘要： 新词识别是中文信息处理领域的关键技术。新词识别主要包括候选字串的提取过滤和词性猜测两项任务。中文没有特定符号标志词边界，因此任何相部字符都有成词的可能性，这给新词提取过滤带来了很大困难;由于没有先验知识和统计数据，新词词性猜测一直是中文词性标注的技术瓶颈。详细分析了中文新词识别技术的研究现状，重点讨论了候选新词提取和词性猜测的研究方法与存在的主要问题，最后对新词识别研究方向进行了展望。
关键词: 新词识别，未登录词，候选字串，训练语料，词性猜测
Abstract: New Words Identification (NWI) is a key technology in the field of Chinese information processing. NWI mainly includes two tasks;one is new words candidate extracting and filtering, the other is new words POS guessing.Since there is no specific symbol to mark word boundary for Chinese words,any adjacent characters are possible to compose a word, which brings a lot of obstacles for NWI. Moreover, because the prior knowledge and statistical data are not available, new words POS guessing has become the technological bottleneck of Chinese tagging. The status of the field for Chinese NWI was analyzed in detail, and the research techniques and existing problems for new words candidates extrading and new words POS guessing were discussed emphatically. In the end, the paper presented the prospects of the study for Chinese NWI.
Key words: Ncw words Identification, Unknown words, Candidate string, Draining corpus, POS guessing
张海军,史树敏,朱朝勇,黄河燕. 中文新词识别技术综述[J]. 计算机科学, 2010, 37(3): 6-10. https://doi.org/
ZHANG Hai-jun,SHI Shu-min,ZHU Chao-yong,HUANG He-yan. Survey of Chinese New Words Identification[J]. Computer Science, 2010, 37(3): 6-10. https://doi.org/
0 / / 推荐
导出引用管理器 EndNote|Reference Manager|ProCite|BibTeX|RefWorks
链接本文: https://www.jsjkx.com/CN/
https://www.jsjkx.com/CN/Y2010/V37/I3/6
Cited
首页