Computer Science ›› 2022, Vol. 49 ›› Issue (12): 305-311.doi: 10.11896/jsjkx.211100264

• Artificial Intelligence • Previous Articles     Next Articles

PosNet:Position-based Causal Relation Extraction Network

ZHU Guang-li, XU Xin, ZHANG Shun-xiang, WU Hou-yue, HUANG Ju   

  1. School of Computer Science and Engineering,Anhui University of Science and Technology,Huainan,Anhui 232001,China
  • Received:2021-11-26 Revised:2022-03-11 Published:2022-12-14
  • About author:ZHU Guang-li,born in 1971,master,associate professor,master supervisor.Her main research interests include Web mining,semantic search,and calculation theory.
  • Supported by:
    National Natural Science Foundation of China(62076006),University Synergy Innovation Program of Anhui Province(GXXT-2021-008) and Anhui Provincial Key R & D Program(202004b11020029).

Abstract: Causal relation extraction is a natural language processing technology to extract causal entity pairs from text,which is widely used in financial,medical and other fields.Traditional causal relationship extraction technology needs to manually select text features for causal matching or use neural networks to extract features many times,resulting in complicated model structure and low extraction efficiency.To solve this problem,this paper proposes a position-based causal relation extraction network(PosNet) to improve the efficiency of causal relation extraction.Firstly,it preprocesses the text and constructs multi-granularity text features as the input of the network.Then passing the text features into the position prediction network,and predicting the start and end positions of causal entities by the classical shallow convolution neural network.Finally,the causal entities are assembled according to the start and end positions by the assembling algorithm,so that all causal entity pairs are extracted.Experimental results show that PosNet can improve the efficiency of causal relation extraction.

Key words: Causal relation extraction, Position information, Text feature representation

CLC Number: 

  • TP391
[1]WANG Z J,WANG S,LI X Q,et al.Review of Event Causality Extraction Based on Deep Learning[J].Journal of Computer Applications,2021,41(5):1247-1255.
[2]ITTOO A,BOUMA G.Extracting explicit and implicit causal relations from sparse,domain-specific texts[C]//International Conference on Application of Natural Language to Information Systems.Berlin:Springer,2011:52-63.
[3]LUO Z,SHA Y,ZHU K Q,et al.Commonsense causal reaso-ning between short texts[C]//Proceedings of the Fifteenth International Conference on Principles of Knowledge Representation and Reasoning.Palo Alto,CA:AAAI Press,2016:421-430.
[4]ZHAO S,LIU T,ZHAO S,et al.Event causality extractionbased on connectives analysis[J].Neurocomputing,2016,173(3):1943-1950.
[5]SEOL J W,YI W,CHOI J,et al.Causality patterns and machine learning for the extraction of problem-action relations in discharge summaries[J].International Journal of Medical Informatics,2017,98:1-12.
[6]LEE D G,SHIN H.Disease causality extraction based on lexical semantics and document-clause frequency from biomedical literature[J].BMC Medical Informatics and Decision Making,2017,17(1):1-9.
[7]LEE S,SEO S,OH B,et al.Cross-sentence N-ary Relation Extraction using Entity Link and Discourse Relation[C]//Procee-dings of the 29th ACM International Conference on Information &Knowledge Management.New York:ACM,2020:705-714.
[8]FRATTINI J,JUNKER M,UNTERKALMSTEINER M,et al.Automatic extraction of cause-effect-relations from requirements artifacts[C]//Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering.NJ:IEEE,2020:561-572.
[9]HEINDORF S,SCHOLTEN Y,WACHSMUTH H,et al.Causenet:Towards a causality graph extracted from the web[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management.New York:ACM,2020:3023-3030.
[10]KRUENGKRAI C,TORISAWA K,HASHIMOTO C,et al.Improving event causality recognition with multiple background knowledge sources using multi-column convolutional neural networks[C]//Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence.Palo Alto,CA:AAAI Press,2017:3466-3473.
[11]ZHENG S,HAO Y,LU D,et al.Joint entity and relation extraction based on a hybrid neural network[J].Neurocomputing,2017,257:59-66.
[12]ZHENG S,WANG F,BAO H,et al.Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme[C]//Procee-dings of the 55th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).PA:ACL,2017:1227-1236.
[13]ZENG X,ZENG D,HE S,et al.Extracting relational facts by an end-to-end neural model with copy mechanism[C]//Proceedings of the 56th Annual Meeting of the Association for Computa-tional Linguistics(Volume 1:Long Papers).PA:ACL,2018:506-514.
[14]DASGUPTA T,SAHA R,DEY L,et al.Automatic extraction of causal relations from text using linguistically informed deep neural networks[C]//Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue.PA:ACL,2018:306-316.
[15]LI P,MAO K.Knowledge-oriented convolutional neural net-work for causal relation extraction from natural language texts[J].Expert Systems with Applications,2019,115:512-523.
[16]LI Z,LI Q,ZOU X,et al.Causality extraction based on self-attentive bilstm-crf with transferred embeddings[J].Neurocomputing,2021,423:207-219.
[17]SAHU S K,THOMAS D,CHIU B,et al.Relation extraction with self-determined graph convolutional network[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management.New York:ACM,2020:2205-2208.
[18]ZHAO K,JI D,HE F,et al.Document-level event causalityidentification via graph inference mechanism[J].Information Sciences,2021,561:115-129.
[19]CAO Y,CHEN D,XU Z,et al.Nested relation extraction with iterative neural network[J].Frontiers of Computer Science,2021,15(3):1-14.
[20]JIAO F,LI H,DOBOLI A.Modeling and extraction of causal information in analog circuits[J].IEEE Transactions on Compu-ter-Aided Design of Integrated Circuits and Systems,2017,37(10):1915-1928.
[21]KIM H,JOUNG J,KIM K.Semi-automatic extraction of technological causality from patents[J].Computers & Industrial Engineering,2018,115:532-542.
[22]MAISONNAVE M,DELBIANCO F,TOHMÉ F,et al.Asses-sing Causality Structures learned from Digital Text Media[C]//Proceedings of the ACM Symposium on Document Engineering 2020.New York:ACM,2020:1-4.
[23]NASAR Z,JAFFRY S W,MALIK M K.Named Entity Recognition and Relation Extraction:State-of-the-Art[J].ACM Computing Surveys(CSUR),2021,54(1):1-39.
[24]MIKOLOV T,CHEN K,CORRADO G,et al.Efficient estimation of word representations in vector space[J].arXiv:1301.3781,2013.
[25]KENTON J D M W C,TOUTANOVA L K.BERT:Pre-trai-ning of Deep Bidirectional Transformers for Language Understanding[C]//Proceedings of NAACL-HLT.PA:ACL,2019:4171-4186.
[26]LAN Z,CHEN M,GOODMAN S,et al.Albert:A lite bert for self-supervised learning of language representations[J].arXiv:1909.11942,2019.
[27]SHAW P,USZKOREIT J,VASWANI A.Self-Attention with Relative Position Representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.PA:ACL,2018:464-468.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] JI Ming-xuan, SONG Yu-rong. New Machine Translation Model Based on Logarithmic Position Representation and Self-attention [J]. Computer Science, 2020, 47(11A): 86-91.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!