计算机科学 ›› 2026, Vol. 53 ›› Issue (7): 125-131.doi: 10.11896/jsjkx.250600098
陈志翔, 谢志鹏
CHEN Zhixiang, XIE Zhipeng
摘要: 事件因果识别任务是一项重要的自然语言处理任务,其目标是识别两个事件之间的因果关系。然而,由于现有公开数据集中因果关系样本稀缺,下游事件因果识别模型的性能提升面临瓶颈。为了解决数据稀缺问题,提出了一种基于大语言模型的事件因果数据增广方法(LLM-ECIAug)。该方法从因果事件对和因果模式两个层面构建数据生成策略,利用大语言模型生成多样化候选增广数据,并结合在原始数据上微调的事件因果过滤器进行因果关系评估。针对候选增广数据与原始数据分布之间的差异,引入了基于KL散度的筛选机制,对生成数据进行排序与筛选,以保留与原始数据分布最为接近的高质量数据。最后,将筛选后的增广数据与原始数据融合,用于训练下游事件因果识别模型。实验结果表明,该方法在Causal-TimeBank与EventStoryLine数据集上的F1值优于多种数据增广基线方法,验证了所提方法的有效性和优越性。
中图分类号:
| [1]GRISHMAN R.Twenty-five years of information extraction[J].Natural Language Engineering,2019,25(6):677-692. [2]WU S,ZHAO R,ZHENG Y,et al.Identify event causality with knowledge and analogy[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2023:13745-13753. [3]FAN C,LIU D,QIN L,et al.Towards event-level causal relation identification [C]//Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval.2022:1828-1833. [4]MU F,LI W.Enhancing event causality identification with counterfactual reasoning[C]//Proceedings of the 61st Annual Mee-ting of the Association for Computational Linguistics.2023:967-975. [5]CAO P,ZUO X,CHEN Y,et al.Knowledge-enriched event causality identification via latent structure induction networks[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:4862-4872. [6]LIU J,ZHANG Z,GUO Z,et al.Kept:Knowledge enhancedprompt tuning for event causality identification[J].Knowledge-Based Systems,2023,259:110064. [7]SHEN S,ZHOU H,WU T,et al.Event causality identification via derivative prompt joint learning[C]//Proceedings of the 29th International Conference on Computational Linguistics.2022:2288-2299. [8]PU R,LI Y,WANG S,et al.Enhancing event causality identification with event causal label and event pair interaction graph[C]//Findings of the Association for Computational Linguistics:ACL 2023.2023:10314-10322. [9]CASELLI T,VOSSEN P.The event storyline corpus:A newbenchmark for causal and temporal relation extraction[C]//Proceedings of the Events and Stories in the News Workshop.2017:77-86. [10]WEI J,ZOU K.EDA:Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing(EMNLP-IJCNLP).2019:6382-6388. [11]DAI H,LIU Z,LIAO W,et al.Auggpt:Leveraging chatgpt for text data augmentation[J].IEEE Transactions on Big Data,2025,11(3):907-918. [12]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2019:4171-4186. [13]MIRZA P,TONELLI S.An analysis of causality between events and its relation to temporal information[C]//Proceedings of 25th International Conference on Computational Linguistics.2014:2097-2106. [14]MARZIEH F,ARIANNA B,CHRISTOF M,et al.Data Augmentation for Low-Resource Neural Machine Translation.[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017:567-573. [15]TOUVRON H,LAVRIL T,IZACARD G,et al.Llama:Openand efficient foundation language models[J].arXiv:2302.13971,2023. [16]BROWN T,MANN B,RYDER N,et al.Language models are few-shot learners[J].Advances in Neural Information Proces-sing Systems,2020,33:1877-1901. [17]KANG M Y,DONGJU P,JAEWOOK K,et al.GPT3Mix:Leveraging Large-scale Language Models for Text Augmentation[C]//Findings of the Association for Computational Linguistics:EMNLP 2021.2021:2225-2239. [18]LU H,LAM W.EPA:Easy Prompt Augmentation on Large Language Models via Multiple Sources and Multiple Targets[J].arXiv:2309.04725,2023. [19]YE J,XU N,WANG Y,et al.Llm-da:Data augmentation via large language models for few-shot named entity recognition[J].arXiv:2402.14568,2024. [20]ZUO X,CHEN Y,LIU K,et al.KnowDis:Knowledge Enhanced Data Augmentation for Event Causality Detection Via Distant Supervision[C]//International Conference on Computational Linguistics.2020:1544-1550. [21]ZUO X,CAO P,CHEN Y,et al.LearnDA:Learnable Know-ledge-Guided Data Augmentation for Event Causality Identification[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:3558-3571 [22]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems(NIPS'13).Red Hook,NY:Curran Associates Inc.,2013:2787-2795. [23]LIU Y,OTT M,GOYAL N,et al.RoBERTa:A Robustly Optimized BERT Pretraining Approach[C]//ICLR 2020.2020. [24]UBANI S,POLAT S O,NIELSEN R.Zeroshotdataaug:Generating and augmenting training data with chatgpt[J].arXiv:2304.14334,2023. |
|
||