Computer Science ›› 2023, Vol. 50 ›› Issue (11): 185-191.doi: 10.11896/jsjkx.221000078

• Artificial Intelligence • Previous Articles     Next Articles

End-to-End Event Coreference Resolution Based on Core Sentence

HUAN Zhigang1,2, JIANG Guoquan1, ZHANG Yujian2, LIU Liu1,3, DING Kun1   

  1. 1 The Sixty-third Research Institute,National University of Defense Technology,Nanjing 210007,China
    2 School of Cyber Science and Engineering,Southeast University,Nanjing 211189,China
    3 School of Information Engineering,Suqian University,Suqian,Jiangsu 223800,China
  • Received:2022-10-10 Revised:2023-03-23 Online:2023-11-15 Published:2023-11-06
  • About author:HUAN Zhigang,born in 1997,postgra-duate,is a student member of China Computer Federation.His main research interests include knowledge graph and natural language processing.JIANG Guoquan,born in 1978,associate research fellow,master,is a member of China Computer Federation.His main research interests include equipment data engineering and knowledge graph.
  • Supported by:
    General Support from China Postdoctoral Science Foundation(2021MD703983) and Scientific Research Program of National University of Defense Technology(ZK20-46).

Abstract: Most previous event coreference resolution models belong to pairwise similarity models,which judge whether the two events are coreferences by calculating the similarity between them.However,when two event mentions appear close to each other in the document,encoding one event contextual representation will introduce information from the other event,which degrades the performance of the model.To solve the problem,an end-to-end event coreference resolution method based on core sentence(ECR-CS) is proposed.The model automatically extracts event information and constructs a core sentence for each event mention according to the preset template,and uses the core sentence representation instead of the event representation.Since the core sentence contains only the information of a single event,the model can eliminate the interference of other event information when encoding the event representation.In addition,limited by the performance of event extraction,the core sentence may lose some important information of the event.The contextual representation of the event in the document is used to make up for this problem.To supplement the missing important information in the core sentence with the contextual information,a gated mechanism is introduced to filter the noise in the contextual representation.Experiments on dataset ACE2005 show that the CoNLL and AVG scores of ECR-CS improves by 1.76 and 1.04,respectively,compared with the state-of-the-art baseline model.

Key words: Event coreference resolution, Gated mechanism, Neural network, Pre-trained language models, Event core sentence

CLC Number: 

  • TPA391
[1]LU J,NG V.Event coreference resolution:a survey of two de-cades of research[C]//Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence.Amsterdam:Elsevier,2018:5479-5486.
[2]MOHAMMED M,MARWA A.Efficient topic detection system for online arabic news [J].International Journal of Computer Applications,2018,180(12):7-12.
[3]CHENG L,GAO H K,WANG H B.A news event extractionmethod in Chinese and Thai languages based on dependency tree elements combined with rules [J].Software Guide,2018,17(7):49-56,63.
[4]WU M Z,MOOSAVI M S,ROTH D,et al.Coreference reaso-ning in machine reading comprehension[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.Stroudsburg:ACL,2021:5768-5781.
[5]DEVLIN J,CHANG M W,LEE K,et al.BERT:pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Stroudsburg,PA:ACL,2019:4171-4186.
[6]LU J,NG V.Span-based event coreference resolution[C]//Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence.Menlo Park,CA:AAAI,2021:13489-13497.
[7]LAI T M,JI H,BUI T,et al.A context-dependent gated module for incorporating symbolic semantics into event coreference re-solution[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Stroudsburg,PA:ACL,2021:3491-3499.
[8]YANG B S,CAIDIE C,FRAZIER P I.A hierarchical distance-dependent bayesian model for event coreference resolution [J].Transactions of the Association for Computational Linguistics,2015(3):517-528.
[9]LIU Z Z,MITAMURA T,HOVY E H.Graph based decoding for event sequencing and coreference resolution[C]//Procee-dings of the 27th International Conference on Computational Linguistic.Stroudsburg:ACL,2018:3645-3657.
[10]CHEN Z,JI H.Graph-based event coreference resolution[C]//Proceedings of the 2009 Workshop on Graph-based Methods for Natural Language Processing.Stroudsburg:ACL,2009:54-57.
[11]KRIMAN S,JI H.Joint detection and coreference resolution of entities and events with document-level context aggregation[C]//Proceedings of the ACL-IJCNLP 2021 Student Research Workshop.Stroudsburg:ACL,2021:174-179.
[12]LU J,NG V.Constrained multi-task learning for event corefe-rence resolution[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Stroudsburg,PA:ACL,2021:4504-4514.
[13]PENG H R,SONG Y Q,ROTH D.Event Detection and Core-ference with Minimal Supervision[C]//In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing,Austin,Texas.Association for Computational Linguistics.2016:392-402.
[14]LIN Y,JI H,HUANG F.A joint neural model for information extraction with global features[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Stroudsburg:ACL,2020:7999-8009.
[15]LEE K,HE L H,LEWIS M,et al.End-to-end neural coreference resolution[C]//Proc of the 2017 Conference on Empirical Me-thods in Natural Language Processing.Stroudsburg:ACL,2017:188-197.
[16]CHEN Y B,XU L H,LIU K,et al.2015.Event extraction via dynamic multi-pooling convolutional neural networks[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing,Beijing,China.Asso-ciation for Computational Linguistics,2015(1):167-176.
[17]JOSHI M,CHEN D Q,LIU Y H,et al.Spanbert:Improvingpre-training by representing and predicting spans [J].Transactions of the Association for Computational Linguistics,2020(8):64-77.
[18]VILAIN M B,BURGER J D,ABERDEEN J S,et al.A model-theoretic coreference scoring scheme[C]//Proceedings of the 6th Conference on Message Understanding.Stroudsburg:ACL,1995:45-52.
[19]BAGGA A,BALDWIN B.Algorithms for scoring coreferencechains[C]//The First Conference Language Resources and Evaluation Coreference.ELRA,1998:563-566.
[20]LUO X Q.On coreference resolution performance metrics[C]//Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing.Stroudsburg:ACL,2005:25-32.
[21]RECASENS M,HOVY E H.BLANC:implementing the randindex for coreference evaluation [J].Natural Language Engineering,2011,17(4):485-510.
[1] LU Yuhan, CHEN Liquan, WANG Yu, HU Zhiyuan. Efficient Encrypted Image Content Retrieval System Based on SecureCNN [J]. Computer Science, 2023, 50(9): 26-34.
[2] HUANG Shuxin, ZHANG Quanxin, WANG Yajie, ZHANG Yaoyuan, LI Yuanzhang. Research Progress of Backdoor Attacks in Deep Neural Networks [J]. Computer Science, 2023, 50(9): 52-61.
[3] YI Qiuhua, GAO Haoran, CHEN Xinqi, KONG Xiangjie. Human Mobility Pattern Prior Knowledge Based POI Recommendation [J]. Computer Science, 2023, 50(9): 139-144.
[4] LI Haiming, ZHU Zhiheng, LIU Lei, GUO Chenkai. Multi-task Graph-embedding Deep Prediction Model for Mobile App Rating Recommendation [J]. Computer Science, 2023, 50(9): 160-167.
[5] ZHU Ye, HAO Yingguang, WANG Hongyu. Deep Learning Based Salient Object Detection in Infrared Video [J]. Computer Science, 2023, 50(9): 227-234.
[6] YI Liu, GENG Xinyu, BAI Jing. Hierarchical Multi-label Text Classification Algorithm Based on Parallel Convolutional Network Information Fusion [J]. Computer Science, 2023, 50(9): 278-286.
[7] HENG Hongjun, MIAO Jing. Fusion of Semantic and Syntactic Graph Convolutional Networks for Joint Entity and Relation Extraction [J]. Computer Science, 2023, 50(9): 295-302.
[8] TANG Shaosai, SHEN Derong, KOU Yue, NIE Tiezheng. Link Prediction Model on Temporal Knowledge Graph Based on Bidirectionally Aggregating Neighborhoods and Global Aware [J]. Computer Science, 2023, 50(8): 177-183.
[9] MA Weiwei, ZHENG Qinhong, LIU Shanshan. Study and Evaluation of Spiking Neural Network Model Based on Bee Colony Optimization [J]. Computer Science, 2023, 50(8): 221-225.
[10] LI Qiaojun, ZHANG Wen, YANG Wei. Fusion Neural Network-based Method for Predicting LncRNA-disease Association [J]. Computer Science, 2023, 50(8): 226-232.
[11] XIE Tonglei, DENG Li, YOU Wenlong, LI Ruilong. Analysis and Prediction of Cloud VM CPU Load Based on EMPC-BCGRU [J]. Computer Science, 2023, 50(8): 243-250.
[12] LI Rongchang, ZHENG Haibin, ZHAO Wenhong, CHEN Jinyin. Data Reconstruction Attack for Vertical Graph Federated Learning [J]. Computer Science, 2023, 50(7): 332-338.
[13] ZHAO Ran, YUAN Jiabin, FAN Lili. Medical Ultrasound Image Super-resolution Reconstruction Based on Video Multi-frame Fusion [J]. Computer Science, 2023, 50(7): 143-151.
[14] JIANG Linpu, CHEN Kejia. Self-supervised Dynamic Graph Representation Learning Approach Based on Contrastive Prediction [J]. Computer Science, 2023, 50(7): 207-212.
[15] ZHU Yuying, GUO Yan, WAN Yizhao, TIAN Kai. New Word Detection Based on Branch Entropy-Segmentation Probability Model [J]. Computer Science, 2023, 50(7): 221-228.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!