Computer Science ›› 2020, Vol. 47 ›› Issue (6A): 40-44.doi: 10.11896/JsJkx.190700042

• Artificial Intelligence • Previous Articles     Next Articles

Relation Extraction Method Combining Encyclopedia Knowledge and Sentence Semantic Features

YU Yi-lin, TIAN Hong-tao, GAO Jian-wei and WAN Huai-yu   

  1. School of Computer and Information Technology,BeiJing Jiaotong University,BeiJing 100044,China
  • Published:2020-07-07
  • About author:LYU Yi-lin, born in 1997, undergra-duate student.His main research interest is information extraction.
    WAN Huai-yu, born in 1981, Ph.D, associate professor, Ph.D supervisor, is a member of China Computer Federation.His main research interests include social network mining, text mining, user behavior analysis, and traffic data mining.
  • Supported by:
    This work was supported by the National Key R&D Program of China (2018YFC0830200).

Abstract: Relation extraction is one of the important research topics in the field of information extraction.Its typical application scenarios include knowledge graphs,question answering systems,machine translation,etc.Recently,deep learning has been applied in a large amount of relation extraction researches,and deep neural networks based relationship extraction method performs much better than the traditional methods in many situations.However,most of the current deep neural network-based relation extraction methods Just rely on the corpus itself and lack the introduction of external knowledge.To address this issue,this paper proposed a neural network model,which combined encyclopedia knowledge and semantic features of sentences for relation extraction.The model introduced the description information of entities in encyclopedia as external knowledge,and dynamically extracted entity features through attention mechanism.Meanwhile,it employed bidirectional LSTM networks to extract the semantic features contained in the sentence.Finally,the model combined the entity features and the sentence semantic features for relation extraction.A series of experiments were carried out based on a manually labeled dataset.Experimental results demonstrate that the proposed model is superior to other existing relationship extraction methods.

Key words: Attention mechanism, Chinese encyclopedia, Entity relation extraction, Long short-term memory

CLC Number: 

  • TP391
[1] ZENG D,LIU K,LAI S,et al.Relation Classification via Convolutional Deep Neural Network //Proceedings of the 25th International Conference on Computational Linguistics.Stroudsburg,PA:ACL,2014:2335-2344.
[2] SANTOS C N,XIANG B,ZHOU B.Classifying Relations by Ranking with Convolutional Neural Networks .arXiv:1504.06580,2015.
[3] NGUYEN T H,GRISHMAN R.Relation extraction:Perspective from convolutional neural networks //Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing.Stroudsburg,PA:ACL,2015:39-48.
[4] ZHANG D,WANG D.Relation Classification via Recurrent Neural Network .arXiv:1508.01006,2015.
[5] ZHANG S,ZHENG D,HU X,et al.Bidirectional long short-term memory networks for relation classification //Procee-dings of the 29th Pacific Asia Conference on Language,Information and Computation.Stroudsburg,PA:ACL,2015:73-78.
[6] ZHOU P,SHI W,TIAN J,et al.Attention-based bidirectional long short-term memory networks for relation classification //Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2:Short Papers).Stroudsburg,PA:ACL,2016:207-212.
[7] BAHDANAU D,CHO K,BENGIO Y.Neural Machine Translation by Jointly Learning to Align and Translate .arXiv:1409.0473,2014.
[8] KAMBHATLA N.Combining lexical,syntactic,and semantic features with maximum entropy models for extracting relations //Proceedings of the ACL Interactive Poster and Demonstration Sessions.Stroudsburg,PA:ACL,2004:22.
[9] SUCHANEK F M,IFRIM G,WEIKUM G.Combining linguistic and statistical analysis to extract relations from web documents //Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM,2006:712-717.
[10] QIAN L,ZHOU G,KONG F,et al.Exploiting constituent dependencies for tree kernel-based semantic relation extraction //Proceedings of the 22nd International Conference on Computational Linguistics.Stroudsburg,PA:ACL,2008:697-704.
[11] BUNESCU R C,MOONEY R J.A shortest path dependency kernel for relation extraction //Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing.Stroudsburg,PA:ACL,2005:724-731.
[12] MOONEY R J,BUNESCU R C.Subsequence kernels for relation extraction //Proceedings of Advances in Neural Information Processing Systems.Stroudsburg,PA:ACL,2006:171-178.
[13] ZENG D,LIU K,CHEN Y,et al.Distant supervision for relation extraction via piecewise convolutional neural networks //Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ACL,2015:1753-1762.
[14] HOCHREITER S,SCHMIDHUBER J.Long short-term memory .Neural computation,1997,9(8):1735-1780.
[15] CHO K,VAN M B,GULCEHRE C,et al.Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation .arXiv:1406.1078,2014.
[16] XU Y,MOU L,LI G,et al.Classifying relations via long short term memory networks along shortest dependency path .arXiv:1508.03720,2015.
[17] MIKOLOV T,CHEN K,CORRADO G,et al.Efficient Estimation of Word Representations in Vector Space .arXiv:1301.3781,2013.
[18] CHE W,LI Z,LIU T.LTP:A Chinese Language Technology Platform //Proceedings of the 23rd International Conference on Computational Linguistics Demonstrations Volume.Stroudsburg,PA:ACL,2010:13-16.
[19] KINGMA D P,BA J.Adam:A method for stochastic optimization .arXiv:1412.6980,2014.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[5] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[6] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[7] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[8] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[9] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[10] WANG Xin-tong, WANG Xuan, SUN Zhi-xin. Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network [J]. Computer Science, 2022, 49(8): 314-322.
[11] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[12] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[13] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
[14] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[15] MENG Yue-bo, MU Si-rong, LIU Guang-hui, XU Sheng-jun, HAN Jiu-qiang. Person Re-identification Method Based on GoogLeNet-GMP Based on Vector Attention Mechanism [J]. Computer Science, 2022, 49(7): 142-147.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!