Computer Science ›› 2023, Vol. 50 ›› Issue (9): 295-302.doi: 10.11896/jsjkx.220700041

• Artificial Intelligence • Previous Articles     Next Articles

Fusion of Semantic and Syntactic Graph Convolutional Networks for Joint Entity and Relation Extraction

HENG Hongjun, MIAO Jing   

  1. College of Computer Science and Technology,Civil Aviation University of China,Tianjin 300300,China
  • Received:2022-07-05 Revised:2022-12-06 Online:2023-09-15 Published:2023-09-01
  • About author:HENG Hongjun,born in 1968,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include intelligent information processing,natural language and knowledge graph.
    MIAO Jing,born in 1998,postgraduate.His main research interests include nature language processing and information extraction.
  • Supported by:
    National Natural Science Foundation of China(U1333109).

Abstract: Entity and relation extraction task is the core task of information extraction.It plays an irreplaceable role in effectively extracting key information from explosive growth data,and is also the basic task of building a large-scale knowledge graph.Therefore,the research on entity relationship extraction task is of great significance for various natural language processing(NLP) tasks.Although the existing entity and relation extraction based on deep learning method has a very mature theory and good performance,there are still some problems,such as error accumulation,entity redundancy,lack of interaction,entity and relation overlap.Semantic information and syntactic information play an important role in NLP tasks.In order to make full use of them to solve the above problems,a fusion of semantic and syntactic graph convolutional networks binary tagging framework for relation triple extraction(FSSRel) is proposed.The model is divided into three stages.In the first stage,the start and end positions of the triple body are predicted.In the second stage,semantic features and syntactic features are extracted by semantic graph neural network and syntactic graph neural network respectively,and fused into the coding vector.In the third stage,the object position of each relation of the statement is predicted and marked to complete the extraction of the final triple.Experimental results show that the F1 value of the model increases by 2.5% and 1.6% respectively compared with the baseline model on the NYT dataset and the WebNLG dataset,and it also performs well on complex data with overlapping triples and multiple triples.

Key words: Joint entity and relation extraction, Semantic information, Syntactic dependency analysis, Graph convolution neural network

CLC Number: 

  • TP391
[1]LI D M,ZHANG Y,LI D Y,et al.Review of entity relation extraction methods [J].Journal of Computer Research and Deve-lopment,2020,57(7):1424-1448.
[2]SHEN Y,MA X,TANG Y,et al.A Trigger-Sense MemoryFlow Framework for Joint Entity and Relation Extraction[C]//Proceedings of the Web Conference 2021.2021:1704-1715.
[3]WU L,CHEN Y,SHEN K,et al.Graph neural networks fornatural language processing:A survey[J].arXiv:2106.06090,2021.
[4]WEI Z,SU J,WANG Y,et al.A novel cascade binary tagging framework for relational triple extraction[J].arXiv:1909.03227,2019.
[5]TIAN Y,CHEN G,SONG Y,et al.Dependency-driven Relation Extraction with Attentive Graph Convolutional Networks[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:4458-4471.
[6]MIWA M,BANSAL M.End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).2016.
[7]EBERTS M,ULGES A.Span-based joint entity and relationextraction with transformer pre-training[J].arXiv:1909.07755,2019.
[8]ZENG X,ZENG D,HE S,et al.Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).2018.
[9]BEKOULIS G,DELEU J,DEMEESTER T,et al.Joint entity recognition and relation extraction as a multi-head selection problem[J].Expert Systems with Applications,2018,114:34-45.
[10]YU B,ZHANG Z,SHU X,et al.Joint extraction of entities and relations based on a novel decomposition strategy[J].arXiv:1909.04273,2019.
[11]NIU W,CHEN Q,ZHANG W,et al.GCN2-NAA:Two-stage Graph Convolutional Networks with Node-Aware Attention for Joint Entity and Relation Extraction[C]//ICMLC 2021:2021 13th International Conference on Machine Learning and Computing.2021.
[12]YAN Z,ZHANG C,FU J,et al.A Partition Filter Network for Joint Entity and Relation Extraction[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:185-197.
[13]ZHENG S,F WANG,BAO H,et al.Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme[C]//Procee-dings of the 55th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).2017.
[14]WANG J,LU W.Two are better than one:Joint entity and relation extraction with table-sequence encoders[J].arXiv:2010.03851,2020.
[15]SUI D,CHEN Y,LIU K,et al.Joint Entity and Relation Extraction with Set Prediction Networks[J].arXiv:2011.01675,2020.
[16]VASWANI A,SHAZEER N,PARMAR N,et al.Attention Is All You Need[J].arXiv:1706.03762,2017.
[17]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018.
[18]MANNING C,SURDEANU M,BAUER J,et al.The stanford core NLP natural language processing toolkit[C]//Proceedings of the 52th Annual Meeting of Association for Computational Linguistics:System Demonstrations.Stroudsburg:ACL Press,2014:55-60.
[19]RIEDEL S,YAO L,MCCALLUM A.Modeling relations andtheir mentions without labeled text[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases.Berlin:Springer,2010:148-163.
[20]GARDENT C,SHIMORINA A,NARAYAN S,et al.Creating training corpora for nlg micro-planning[C]//55th Annual Mee-ting of the Association for Computational Linguistics(ACL).2017.
[21]FU T J,LI P H,MA W Y.Graphrel:Modeling text as relational graphs for joint entity and relation extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Computa-tional Linguistics.2019:1409-1418.
[22]BAI C,PAN L,LUO S,et al.Joint extraction of entities and relations by a novel end-to-end model with a double-pointer mo-dule[J].Neurocomputing,2020,377:325-333.
[23]ZENG X,HE S,ZENG D,et al.Learning the extraction order of multiple relational facts in a sentence with reinforcement lear-ning[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:367-377.
[24]HONG Y,LIU Y,YANG S,et al.Improving graph convolu-tional networks based on relation-aware attention for end-to-end relation extraction[J].IEEE Access,2020,8:51315-51323.
[1] ZHU Xiubao, ZHOU Gang, CHEN Jing, LU Jicang, XIANG Yixin. Single-stage Joint Entity and Relation Extraction Method Based on Enhanced Sequence Annotation Strategy [J]. Computer Science, 2023, 50(8): 184-192.
[2] CHEN Shurui, LIANG Ziran, RAO Yanghui. Fine-grained Semantic Knowledge Graph Enhanced Chinese OOV Word Embedding Learning [J]. Computer Science, 2023, 50(3): 72-82.
[3] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[4] GUO Liang, YANG Xing-yao, YU Jiong, HAN Chen, HUANG Zhong-hao. Hybrid Recommender System Based on Attention Mechanisms and Gating Network [J]. Computer Science, 2022, 49(6): 158-164.
[5] PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song. Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2022, 49(3): 294-300.
[6] SHAO Hai-lin, JI Yi, LIU Chun-ping, XU Yun-long. Scene Text Detection Algorithm Based on Enhanced Feature Pyramid Network [J]. Computer Science, 2022, 49(2): 248-255.
[7] LYU Xiao-shao, SHU Hui, KANG Fei, HUANG Yu-yao. Reverse Location of Software Online Upgrade Function Based on Semantic Guidance [J]. Computer Science, 2022, 49(12): 353-361.
[8] CHENG Hua-ling, CHEN Yan-ping, YANG Wei-zhe, QIN Yong-bin, HUANG Rui-zhang. Relation Extraction Based on Multidimensional Semantic Mapping [J]. Computer Science, 2022, 49(11): 206-211.
[9] WU Lan, WANG Han, LI Bin-quan. Unsupervised Domain Adaptive Method Based on Optimal Selection of Self-supervised Tasks [J]. Computer Science, 2021, 48(6A): 357-363.
[10] HUO Dan, ZHANG Sheng-jie, WAN Lu-jun. Context-based Emotional Word Vector Hybrid Model [J]. Computer Science, 2020, 47(11A): 28-34.
[11] LU Hai-chuan, FU Hai-dong, LIU Yu. Geo-semantic Data Storage and Retrieval Mechanism Based on CAN [J]. Computer Science, 2019, 46(2): 171-177.
[12] ZHANG Qun, WANG Hong-jun and WANG Lun-wen. Short Text Clustering Algorithm Combined with Context Semantic Information [J]. Computer Science, 2016, 43(Z11): 443-446.
[13] WU Zhi-peng HUANG Zhi-qiu WANG Shan-shan CAO De-jian. Research on Framework of Safety Verification Based on Fault-extended SysML Activity Diagram [J]. Computer Science, 2015, 42(7): 222-228.
[14] YOU Hong-tao,ZHANG Yan-yuan,LIN Yi and LIU Sheng. Based on the Semantic Information of the Stored Energy Efficiency Research [J]. Computer Science, 2013, 40(Z6): 112-114.
[15] . Semantic-based Chinese Web Page Retrieval [J]. Computer Science, 2012, 39(8): 79-87.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!