计算机科学 ›› 2026, Vol. 53 ›› Issue (7): 125-131.doi: 10.11896/jsjkx.250600098

• 人工智能 • 上一篇    下一篇

基于大语言模型的事件因果数据增广方法

陈志翔, 谢志鹏   

  1. 复旦大学计算与智能创新学院 上海 200438
  • 收稿日期:2025-06-16 修回日期:2025-09-11 出版日期:2026-07-15 发布日期:2026-07-10
  • 通讯作者: 谢志鹏(xiezp@fudan.edu.cn)
  • 作者简介:(zxchen8830@qq.com)
  • 基金资助:
    国家重点研发计划(2023YFD1600300)

Event Causal Data Augmentation Method Based on Large Language Model

CHEN Zhixiang, XIE Zhipeng   

  1. College of Computer Science and Artificial Intelligence,Fudan University,Shanghai 200438,China
  • Received:2025-06-16 Revised:2025-09-11 Published:2026-07-15 Online:2026-07-10
  • About author:CHEN Zhixiang,born in 1999,postgra-duate.His main research interest is na-tural language processing.
    XIE Zhipeng,born in 1976,associate professor,Ph.D supervisor,is a member of CCF(No.50903M).His main research interests include data mining,machine learning and natural language processing.
  • Supported by:
    National Key R&D Program of China(2023YFD1600300).

摘要: 事件因果识别任务是一项重要的自然语言处理任务,其目标是识别两个事件之间的因果关系。然而,由于现有公开数据集中因果关系样本稀缺,下游事件因果识别模型的性能提升面临瓶颈。为了解决数据稀缺问题,提出了一种基于大语言模型的事件因果数据增广方法(LLM-ECIAug)。该方法从因果事件对和因果模式两个层面构建数据生成策略,利用大语言模型生成多样化候选增广数据,并结合在原始数据上微调的事件因果过滤器进行因果关系评估。针对候选增广数据与原始数据分布之间的差异,引入了基于KL散度的筛选机制,对生成数据进行排序与筛选,以保留与原始数据分布最为接近的高质量数据。最后,将筛选后的增广数据与原始数据融合,用于训练下游事件因果识别模型。实验结果表明,该方法在Causal-TimeBank与EventStoryLine数据集上的F1值优于多种数据增广基线方法,验证了所提方法的有效性和优越性。

关键词: 事件因果识别, 数据增广, 大语言模型, KL散度, 文本生成

Abstract: Event causality identification(ECI) is an important NLP task that aims to identify causal relationships between two events.However,due to the scarcity of causal data in public datasets,downstream ECI models have encountered bottlenecks.To alleviate the data scarcity problem,this paper proposes a large language model-based event causality data augmentation method(LLM-ECIAug).This method constructs a data generation strategy from two levels:causal event pairs and causal patterns.It utilizes large language models to generate diverse candidate augmentation data and combines an event causality filter fine-tuned on the original ECI datasets.In view of the differences between the distribution of candidate augmented data and the original data,a filtering mechanism based on KL divergence is introduced to rank and filter the generated data,retaining high-quality data that are most consistent with the original data distribution.Finally,the filtered augmented data is combined with the original data to train the downstream ECI model.Experimental results show that this method achieves better F1 scores than other data augmentation baseline methods on the Causal-TimeBank and EventStoryLine datasets,confirming its effectiveness and superiority.

Key words: Event causality identification, Data augmentation, Large language models, KL divergence, Text generation

中图分类号: 

  • TP391
[1]GRISHMAN R.Twenty-five years of information extraction[J].Natural Language Engineering,2019,25(6):677-692.
[2]WU S,ZHAO R,ZHENG Y,et al.Identify event causality with knowledge and analogy[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2023:13745-13753.
[3]FAN C,LIU D,QIN L,et al.Towards event-level causal relation identification [C]//Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval.2022:1828-1833.
[4]MU F,LI W.Enhancing event causality identification with counterfactual reasoning[C]//Proceedings of the 61st Annual Mee-ting of the Association for Computational Linguistics.2023:967-975.
[5]CAO P,ZUO X,CHEN Y,et al.Knowledge-enriched event causality identification via latent structure induction networks[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:4862-4872.
[6]LIU J,ZHANG Z,GUO Z,et al.Kept:Knowledge enhancedprompt tuning for event causality identification[J].Knowledge-Based Systems,2023,259:110064.
[7]SHEN S,ZHOU H,WU T,et al.Event causality identification via derivative prompt joint learning[C]//Proceedings of the 29th International Conference on Computational Linguistics.2022:2288-2299.
[8]PU R,LI Y,WANG S,et al.Enhancing event causality identification with event causal label and event pair interaction graph[C]//Findings of the Association for Computational Linguistics:ACL 2023.2023:10314-10322.
[9]CASELLI T,VOSSEN P.The event storyline corpus:A newbenchmark for causal and temporal relation extraction[C]//Proceedings of the Events and Stories in the News Workshop.2017:77-86.
[10]WEI J,ZOU K.EDA:Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing(EMNLP-IJCNLP).2019:6382-6388.
[11]DAI H,LIU Z,LIAO W,et al.Auggpt:Leveraging chatgpt for text data augmentation[J].IEEE Transactions on Big Data,2025,11(3):907-918.
[12]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2019:4171-4186.
[13]MIRZA P,TONELLI S.An analysis of causality between events and its relation to temporal information[C]//Proceedings of 25th International Conference on Computational Linguistics.2014:2097-2106.
[14]MARZIEH F,ARIANNA B,CHRISTOF M,et al.Data Augmentation for Low-Resource Neural Machine Translation.[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017:567-573.
[15]TOUVRON H,LAVRIL T,IZACARD G,et al.Llama:Openand efficient foundation language models[J].arXiv:2302.13971,2023.
[16]BROWN T,MANN B,RYDER N,et al.Language models are few-shot learners[J].Advances in Neural Information Proces-sing Systems,2020,33:1877-1901.
[17]KANG M Y,DONGJU P,JAEWOOK K,et al.GPT3Mix:Leveraging Large-scale Language Models for Text Augmentation[C]//Findings of the Association for Computational Linguistics:EMNLP 2021.2021:2225-2239.
[18]LU H,LAM W.EPA:Easy Prompt Augmentation on Large Language Models via Multiple Sources and Multiple Targets[J].arXiv:2309.04725,2023.
[19]YE J,XU N,WANG Y,et al.Llm-da:Data augmentation via large language models for few-shot named entity recognition[J].arXiv:2402.14568,2024.
[20]ZUO X,CHEN Y,LIU K,et al.KnowDis:Knowledge Enhanced Data Augmentation for Event Causality Detection Via Distant Supervision[C]//International Conference on Computational Linguistics.2020:1544-1550.
[21]ZUO X,CAO P,CHEN Y,et al.LearnDA:Learnable Know-ledge-Guided Data Augmentation for Event Causality Identification[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:3558-3571
[22]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems(NIPS'13).Red Hook,NY:Curran Associates Inc.,2013:2787-2795.
[23]LIU Y,OTT M,GOYAL N,et al.RoBERTa:A Robustly Optimized BERT Pretraining Approach[C]//ICLR 2020.2020.
[24]UBANI S,POLAT S O,NIELSEN R.Zeroshotdataaug:Generating and augmenting training data with chatgpt[J].arXiv:2304.14334,2023.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!