Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 119-124.doi: 10.11896/jsjkx.210600150

• Intelligent Computing • Previous Articles     Next Articles

Relation Classification Method Based on Cross-sentence Contextual Information for Neural Network

HUANG Shao-bin, SUN Xue-wei, LI Rong-sheng   

  1. College of Computer Science and Technology,Harbin Engineering University,Harbin 150001,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:HUANG Shao-bin,born in 1965,Ph.D,professor,Ph.D supervisor.His main research interests include natural language processing and deep learning,etc.
    LI Rong-sheng,born in 1991,Ph.D.His main research interests include natural language processing and deep learning,etc.

Abstract: Information extraction is a technique of extracting specific information from textual data.It has been widely used in knowledge graph,information retrieval,question answering system,sentiment analysis and text mining.As the core task and important part of information extraction,relation classification can realize the recognition of semantic relations between entities.In recent years,deep learning has made remarkable achievements in relation extraction tasks.So far,researchers have focused their efforts on improving neural network models,but there is still a lack of effective methods to obtain cross-sentence semantic information from paragraphs or discourse level texts with close semantic relationships between different sentences.However,semantic relationships between sentences for relation extraction tasks are of great use.In this paper,for such paragraphs or discourse level relation extraction datasets,a method to combine sentences with their cross-contextual information as the input of the neural network model is proposed,so that the model can learn more semantic information from paragraphs or discourse level texts.Cross-sentence contex tual information is introduced into different neural network models,and experiments are carried out on two relation classification datasets in different fields including San Wen dataset and Policy dataset.The effects of cross-sentence contex-tual information on model accuracy are compared.The experiment show that the proposed method can effectively improve the performance of relation classification models including Convolutional neural network,bidirectional long short-term memory network,attention-based bidirectional long short-term memory network and convolutional recurrent neural network.In addition,this paper proposes a relation classification dataset named Policy based on the texts of policies and regulations in the field of four social insurance and one housing fund,which is used to verify the necessity of introducing cross-sentence contextual information into the relation classification tasks in some practical fields.

Key words: Cross-sentence contextual information, Four social insurance and one housing fund, Neural network, Relation classification, Sentence similarity

CLC Number: 

  • TP391.1
[1] LIU C Y,SUN W B,CHAO W H,et al.Convolution NeuralNetwork for Relation Extraction[C]//International Conference on Advanced Data Mining and Applications.Springer Berlin Heidelberg,2013.
[2] ZENG D,LIU K,LAI S,et al.Relation classification via convolutional deep neural network[C]//25th International Confe-rence on Computational Linguistics:Technical Papers(COLING 2014).2014:2335-2344.
[3] SANTOS C N D,XIANG B,ZHOU B W.Classifying Relations by Ranking with Convolutional Neural Networks[J].Computer Science,2015,86(86):132-137.
[4] QIN P,XU W,GUO J.An empirical convolutional neural net-work approach for semantic relation classification[J].Neurocomputing,2016,190:1-9.
[5] REN F,ZHOU D,LIU Z,et al.Neural relation classification with text descriptions[C]//Proceedings of the 27th InternationalConference on Computational Linguistics.2018:1167-1177.
[6] ZENG D,LIU K,CHEN Y,et al.Distant supervision for relation extraction via piecewise convolutional neural networks[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:1753-1762.
[7] JI G,LIU K,HE S,et al.Distant supervision for relation extraction with sentence-level attention and entity descriptions[C]//Thirty-First AAAI Conference on Artificial Intelligence.2017.
[8] ZHANG D,WANG D.Relation classification via recurrent neural network[J].arXiv:1508.01006,2015.
[9] ZHOU P,SHI W,TIAN J,et al.Attention-based bidirectional long short-term memory networks for relation classification[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics(Short Papers).2016:207-212.
[10] DU J,HAN J,WAY A,et al.Multi-level structured self-attentions for distantly supervised relation extraction[J].arXiv:1809.00699,2018.
[11] VU N T,ADEL H,GUPTA P.Combining Recurrent and Convolutional Neural Networks for Relation Classification[C]//Proceedings of NAACL-HLT.2016:534-539.
[12] TRAN V H,PHI V T,SHINDO H,et al.Relation Classification Using Segment-Level Attention-based CNN and Dependency-based RNN[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,Volume 1(Long and Short Papers).2019:2793-2798.
[13] SOARES L B,FITZGERALD N,LING J,et al.Matching the blanks:Distributional similarity for relation learning[J].arXiv:1906.03158,2019.
[14] LEE J,SEO S,CHOI Y S.Semantic Relation Classification via Bidirectional LSTM Networks with Entity-aware Attention using Latent Entity Typing[J].Symmetry,2019,11(6):785.
[15] WU S,HE Y.Enriching Pre-trained Language Model with Entity Information for Relation Classification[C]//the 28th ACM International Conference.ACM,2019.
[16] LI Z,DING N,LIU Z,et al.Chinese Relation Extraction with Multi-Grained Information and External Linguistic Knowledge[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.2019.
[17] ZHU H,LIN Y,LIU Z,et al.Graph Neural Networks with Generated Parameters for Relation Extraction[C]//Meeting of the Association for Computational Linguistics.2019.
[18] ZHANG Y,GUO Z,LU W.Attention guided graph convolutional networks for relation extraction[J].arXiv:1906.07510,2019.
[19] WADDEN D,WENNBERG U,LUAN Y,et al.Entity,relation,and event extraction with contextualized span representations[C]//Empirical Methods in Natural Language Processing(EMNLP). 2019:5788-5793.
[20] LIN C,MILLER T,DLIGACH D,et al.A BERT-based One-Pass Multi-Task Model for Clinical Temporal Relation Extraction[C]//Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing.2020:70-75.
[21] SONG R,CHEN X,HONG Y,et al.Combination of Convolutional Recurrent Neutral Network for Relation Extraction[J].Journal of Chinese Information Processing,2019,33(10):64-72.
[1] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[2] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[5] WANG Run-an, ZOU Zhao-nian. Query Performance Prediction Based on Physical Operation-level Models [J]. Computer Science, 2022, 49(8): 49-55.
[6] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[7] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[8] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[9] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[10] ZHAO Dong-mei, WU Ya-xing, ZHANG Hong-bin. Network Security Situation Prediction Based on IPSO-BiLSTM [J]. Computer Science, 2022, 49(7): 357-362.
[11] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[12] YANG Bing-xin, GUO Yan-rong, HAO Shi-jie, Hong Ri-chang. Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition [J]. Computer Science, 2022, 49(7): 57-63.
[13] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[14] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[15] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!