计算机科学 ›› 2023, Vol. 50 ›› Issue (2): 292-299.doi: 10.11896/jsjkx.211200108

• 人工智能 • 上一篇    下一篇

基于联合模型的端到端事件可信度识别

曹金娟, 钱忠, 李培峰   

  1. 苏州大学计算机科学与技术学院 江苏 苏州 215006
  • 收稿日期:2021-12-09 修回日期:2022-03-16 出版日期:2023-02-15 发布日期:2023-02-22
  • 通讯作者: 钱忠(qianzhong@suda.edu.cn)
  • 作者简介:(20194227035@stu.suda.edu.cn)
  • 基金资助:
    国家自然科学基金(61772354,61836007,61773276);江苏高校优势学科建设工程资助项目

End-to-End Event Factuality Identification with Joint Model

CAO Jinjuan, QIAN Zhong, LI Peifeng   

  1. School of Computer Sciences and Technology,Soochow University,Suzhou,Jiangsu 215006,China
  • Received:2021-12-09 Revised:2022-03-16 Online:2023-02-15 Published:2023-02-22
  • Supported by:
    National Natural Science Foundation of China(61772354,61836007,61773276) and Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions

摘要: 事件可信度是对文本中事件真实情况的一种描述,是自然语言处理领域许多相关应用的基本任务。目前,大多数关于事件可信度的相关研究都是使用标注的事件进行事件可信度识别,不方便实际应用,并且忽略了不同事件源对事件可信度的影响。针对现有问题,提出了一个端到端的事件可信度识别的联合模型JESF。该模型可以同时进行事件识别、事件源识别、事件可信度识别3个任务;使用BERT(Bidirectional Encoder Representations from Transformers)和语言学特征加强单词的语义表示;使用注意力机制(Attention)和依存句法树构建图卷积神经网络(Graph Convolutional Network,GCN),以有效地提取语义和句法特征。特别地,该模型也可以应用于只考虑默认源(文本作者)的事件可信度任务。在FactBank,Meantime,UW,UDS-IH2等语料上的实验结果显示,所提模型优于基准模型。

关键词: 事件可信度识别, 端到端, 联合模型, 图卷积神经网络, BERT

Abstract: Event factuality is the description of the real situation of events in text.It is the basic task of many related applications in the field of natural language processing.At present,most researches on event factuality use labeled events to identify event factuality,which is inconvenient for practical application,and ignores the impact of different event sources on event factuality.Aiming at the existing problems,an end-to-end joint model JESF for event factuality identification is proposed.The model can carry out three tasks at the same time:event identification,event source identification and event factuality identification.Using bidirectional encoder representations from transformers(BERT)and linguistic features to strengthen the semantic representation of words.Graph convolutional network(GCN) is constructed by using attention mechanism and dependency syntax tree to effectively extract semantic and syntactic features.In particular,the model can also be applied to the task of event factuality considering only the default source(text author).Experimental results on FactBank,Meantime,UW and UDS-IH2 show that the proposed model is better than the benchmark model.

Key words: Event factuality identification, End-to-End, Joint model, Graph convolutional network, Bidirectional encoder representations from transformers

中图分类号: 

  • TP391
[1]QIAN Z,LI P F,ZHANG Y,et al.Event factuality identification via generative adversarial networkswith auxiliary classification[C]//Proceedings of the Joint Conference on Artificial Intelligence.2018:4293-4300.
[2]VEYSEH A P B,NGUYEN T H,DOU D.Graph based neural networks for event factuality prediction using syntactic and semantic structures[C]//Proceedings of ACL.2019:4393-4399.
[3]DEVLIN J,CHANG M W,LEE K,et al.Bert:pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of NAACL-HLT.2019:4171-4186.
[4]KIPF T N,WELLING M.Semi-supervised classification withgraph convolutional networks [C]//Proceedings of ICLR.2017:1-14.
[5]CAO J J,QIAN Z,LI P F,et al.End-to-end event factualityidentification via hybrid neural networks[C]//Proceedings of CCKS.2020:196-208.
[6]JIANG J J,DE MARNEFFE M C.He thinks he knows better than the doctors:bert for event factuality fails on pragmatics[J].Transactions of the Association for Computational Linguistics,2021,9:1081-1097.
[7]SAURÍ R.A factuality profiler for eventualities in text[D].Massachusetts:Brandeis University,2008.
[8]LOTAN A,STERN A,DAGAN I.Truthteller:annotating pre-dicate truth[C]//Proceedings of NAACL-HLT.2013:752-757.
[9]DE MARNEFFE M C,MANNING C D,POTTS C.Did it happen? the pragmatic complexity of veridicality assessment[J].Computational Linguistics,2012,38(2):301-333.
[10]SAURÍ R,PUSTEJOVSKY J.Are you sure that this happened? assessing the factuality degree of events in text[J].Computational Linguistics,2012,38(2):261-299.
[11]QIAN Z,LI P F,ZHU Q M.A two-step approach for event factuality identification[C]//Proceedings of IALP.2015:103-106.
[12]ZHANG Y,LI P F,ZHU Q M.Document-level event factuality identification method with gated convolution networks[J].Computer Science,2020,47(3):206-210.
[13]CAO P F,CHEN Y B,YANG Y Q,et al.Uncertain local-to-global networks for document-level event factuality identification[C]//Proceedings of EMNLP.2021:2636-2645.
[14]SAURÍ R,PUSTEJOVSKY J.Factbank:a corpus annotatedwith event factuality[J].Language Resourcesand Evaluation,2009,43(3):227-268.
[15]MINARD A L,SPERANZA M,URIZAR R,et al.Meantime,the newsreader multilingual event and time corpus[C]//Proceedings of LREC.2016:4417-4422.
[16]LEE K,ARTZI Y,CHOI Y,et al.Event detection and factuality assessment with non-expert supervision[C]//Proceedings of EMNLP.2015:1643-1648.
[17]WHITE A S,REISINGER D,SAKAGUCHI K,et al.Universal decompositional semantics on universal dependencies[C]//Proceedings of EMNLP.2016:1713-1723.
[18]RUDINGER R,WHITE A S,DURME B V.Neural models of factuality[C]//Proceedings of NAACL-HLT.2018:731-744.
[19]HORN L R.A natural history of negation[M].Chicago:University of Chicago Press,1989.
[20]PENNINGTON J,SOCHER R,MANNING C.Glove:globalvectors for word representation[C]//Proceedings of EMNLP.2014:1532-1543.
[21]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Proceedings of NIPS.2017:5998-6008.
[1] 李帅, 徐彬, 韩祎珂, 廖同鑫.
SS-GCN:情感增强和句法增强的方面级情感分析模型
SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement
计算机科学, 2023, 50(3): 3-11. https://doi.org/10.11896/jsjkx.220700238
[2] 邓亮, 齐攀虎, 刘振龙, 李敬鑫, 唐积强.
BGPNRE:一种基于BERT的全局指针网络实体关系联合抽取方法
BGPNRE:A BERT-based Global Pointer Network for Named Entity-Relation Joint Extraction Method
计算机科学, 2023, 50(3): 42-48. https://doi.org/10.11896/jsjkx.220600239
[3] 冯程程, 刘派, 姜琳颖, 梅笑寒, 郭贵冰.
文档增强型知识库问答
Document-enhanced Question Answering over Knowledge-Bases
计算机科学, 2023, 50(3): 266-275. https://doi.org/10.11896/jsjkx.220300022
[4] 刘哲, 殷成凤, 李天瑞.
基于BERT和多特征融合嵌入的中文拼写检查
Chinese Spelling Check Based on BERT and Multi-feature Fusion Embedding
计算机科学, 2023, 50(3): 282-290. https://doi.org/10.11896/jsjkx.220100104
[5] 陈云芳, 陆洋洋, 周鑫, 张伟.
基于互相关注意力的链式帧处理多目标跟踪算法
Multi-object Tracking Based on Cross-correlation Attention and Chained Frames
计算机科学, 2023, 50(1): 131-137. https://doi.org/10.11896/jsjkx.211100097
[6] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[7] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[8] 于家畦, 康晓东, 白程程, 刘汉卿.
一种新的中文电子病历文本检索模型
New Text Retrieval Model of Chinese Electronic Medical Records
计算机科学, 2022, 49(6A): 32-38. https://doi.org/10.11896/jsjkx.210400198
[9] 康雁, 吴志伟, 寇勇奇, 张兰, 谢思宇, 李浩.
融合Bert和图卷积的深度集成学习软件需求分类
Deep Integrated Learning Software Requirement Classification Fusing Bert and Graph Convolution
计算机科学, 2022, 49(6A): 150-158. https://doi.org/10.11896/jsjkx.210500065
[10] 余本功, 张子薇, 王惠灵.
一种融合多层次情感和主题信息的TS-AC-EWM在线商品排序方法
TS-AC-EWM Online Product Ranking Method Based on Multi-level Emotion and Topic Information
计算机科学, 2022, 49(6A): 165-171. https://doi.org/10.11896/jsjkx.210400238
[11] 李荪, 曹峰.
智能语音技术端到端框架模型分析和趋势研究
Analysis and Trend Research of End-to-End Framework Model of Intelligent Speech Technology
计算机科学, 2022, 49(6A): 331-336. https://doi.org/10.11896/jsjkx.210500180
[12] 郭雨欣, 陈秀宏.
融合BERT词嵌入表示和主题信息增强的自动摘要模型
Automatic Summarization Model Combining BERT Word Embedding Representation and Topic Information Enhancement
计算机科学, 2022, 49(6): 313-318. https://doi.org/10.11896/jsjkx.210400101
[13] 李子仪, 周夏冰, 王中卿, 张民.
基于用户关联的立场检测
Stance Detection Based on User Connection
计算机科学, 2022, 49(5): 221-226. https://doi.org/10.11896/jsjkx.210400135
[14] 高越, 傅湘玲, 欧阳天雄, 陈松龄, 闫晨巍.
基于时空自适应图卷积神经网络的脑电信号情绪识别
EEG Emotion Recognition Based on Spatiotemporal Self-Adaptive Graph ConvolutionalNeural Network
计算机科学, 2022, 49(4): 30-36. https://doi.org/10.11896/jsjkx.210900200
[15] 李浩, 张兰, 杨兵, 杨海潇, 寇勇奇, 王飞, 康雁.
融合双重权重机制和图卷积神经网络的微博细粒度情感分类
Fine-grained Sentiment Classification of Chinese Microblogs Combining Dual Weight Mechanismand Graph Convolutional Neural Network
计算机科学, 2022, 49(3): 246-254. https://doi.org/10.11896/jsjkx.201200073
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!