Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 230800179-6.doi: 10.11896/jsjkx.230800179

• Artificial Intelligenc • Previous Articles     Next Articles

Application of Subject Enhanced Cascade Binary Pointer Tagging Framework in Chinese Medical Entity and Relation Extraction

JIANG Zhihan1, ZAN Hongying2, ZHANG Li3   

  1. 1 Collage of Software,Jilin University,Changchun 130012,China
    2 School of Computer and Artificial Intelligence,Zhengzhou University,Zhengzhou 450001,China
    3 Collage of Life Science,Jilin University,Changchun 130012,China
  • Published:2024-06-06
  • About author:JIANG Zhihan,born in 2003,undergraduate.His main research interests include natural language processing and mathematical optimization.
    ZAN Hongying,born in 1966,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.E20-0008671S).Her main research interests include natural language processing and affective computing.

Abstract: With the rapid advancement of China’s biomedical industry,the volume of Chinese medical texts is escalating at a rapid pace.Extracting valuable information from these texts can ease the learning curve for practitioners.To tackle the challenge of entity relation extraction in the realm of Chinese medicine,a series of models based on bidirectional LSTM have been previously proposed.However,to overcome the training speed bottleneck inherent to bidirectional LSTM,this study introduces the Cascade binary pointer network framework to the domain of Chinese medical filed.To address the framework’s weak capability in identifying main entities and the gradient issues arising from reusing the coding layer,this paper introduces the main entity enhancement module and employs conditional layer normalization.This paper presents the subject enhanced cascade binary pointer tagging framework for chinese medical text (SE-CAS),tailored for Chinese medical text.The subject enhancement module accurately identifies valid subjects detected by the subject recognition module and rectifies erroneously identified entities.Furthermore,the conditional layer normalization method replaces the simplistic addition between word embeddings and subject embeddings found in the original model.Experimental results demonstrate that the proposed model achieves a 5.73% enhancement in F1 measure on the CMeIE dataset.The ablation study confirms the incremental impact of each module,and these improvements exhibit a cumulative effect.

Key words: Entity relation extraction, CASREL, Medical relation extraction, Deeplearning, Subject recognition

CLC Number: 

  • TP391
[1]WEI Z P,SU J L,WANG Y,et al.A Novel Cascade Binary Tagging Framework for Relational Triple Extraction[C]//Procee-dings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:1475-1488.
[2]ZAN H Y,GUAN T F,ZHANG K L,et al.Review of entity relation extraction for medical texts[J].J.Zhengzhou Univ.(Nat.Sci.Ed),2020,52(4):1-15.
[3]ZHENG S C,WANG F,BAO H Y,et al.Joint Extraction of Entities and RelationsBased on a Novel Tagging Scheme[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017:1227-1236.
[4]LI H,LIU Y J,XIE Q,et al.Distant Supervision Relation Extraction Model Based on Multi-level Attention Mechanism[J].Computer Science,2019,46(10):252-257.
[5]ZENG X R,ZENG D J,HE S Z,et al.Extracting RelationalFacts by an End-to-End Neural Model with Copy Mechanism[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.2018:506-514.
[6]FU T J,LI P H,MA W Y.GraphRel:Modeling Text as Relational Graphs for Joint Entity and Relation Extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.2019:1409-1418.
[7]ZENG X R,HE S S,ZENG D J,et al.Learning the Extraction Order of Multiple Relational Facts in a Sentence with Reinforcement Learning[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:367-377.
[8]ZENG D J,ZHANG R H,LIU Q Y.CopyMTL:Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:9507-9514.
[9]DEVLIN J,CHANG M W,LEE K,et al.BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2019:4171-4186.
[10]WANG Y C,YU B W,ZHANG Y Y,et al.TPLinker:Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking[C]//Proceedings of the 28th International Conference on Computational Linguistics.2020:1572-1582.
[11]MA L B,REN H M,ZHANG X L.Effective Cascade Dual-Decoder Model for Joint Entity and Relation Extraction[DB/OL].(2021-06-27)[2023-08-22].https://arxiv.orgabs/2106.14163.
[12]ZHU X B,ZHOU G,CHEN J,et al.Single-stage Joint Entity Relation Extraction Method Based on Enhanced Sequence Annotation Strategy[J].Computer Science.2023,50(8):184-192.
[13]UZUNER Ö,SOUTH B R,SHEN S Y,et al.2010 i2b2/VA challenge on concepts,assertions,and relations in clinical text[J].Journal of the American Medical Informatics Association,2011,18(5):552-556.
[14]WEI C H,PENG Y F,LEAMAN R,et al.Overview of the BioCreative V Chemical Disease Relation(CDR) Task[C]//Proceeding of the 5th BioCreative Challenage Evaluation Workshop.2015:154-156.
[15]SAHU S K,ANAND A,ORUGANTY K,et al.Relation extraction from clinical texts using domain invariant convolutional neural network[C]//Proceeding of the 15th Workshop on Biomedical Natural Language Processing.2016:206-215.
[16]ZHANG Y J,LIN H F,YANG Z H,et al.A hybrid model based on neural networks for biomedical relation extraction[J].Journal of Biomedical Informatics,2018,81:83-92.
[17]LIU Z J,YANG M,WANG X L,et al.Entity recognition from clinical texts via recurrent neural network[J].BMC Medical Informatics and Decision Making,2017,17(2):53-61.
[18]LUO L,YANG Z H,CAO M Y,et al.A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature[J].Journal of Biomedical Informatics,2020,103:103384.
[19]LEE J,YOON W,KIM S,et al.BioBERT:a pre-trained biome-dical language representation model for biomedical text mining[J].Bioinformatics,2020,36(4):1234-1240.
[20]ZHANG S H,U S D,JIA Z,et al.Medical Entity Relation Extraction Based on Deep Network and Self-attention Mechanism[J].Computer Science,2021,48(10):77-84.
[21]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.2017:6000-6010.
[22]SANTURKAR S,TSIPRAS D,ILYAS A,et al.How DoesBatch Normalization Help Optimization?[DB/OL].(2019-04-15)[2023-08-22].https://arxiv.org/abs/1805.11604.
[23]SU J L.Conditional text generation Based on Conditional Layer Normalization[EP/OL].(2019-12-14)[2023-08-22].https://spaces.ac.cn/archives/7124.
[24]GAN Z F,ZAN H Y,GUAN T F,et al.Overview of CHIP 2020 Shared Task 2:Entity and Relation Extraction in Chinese Medical Text[J].Journal of Chinese Information Processing,2022,36(6):101-108.
[25]BEKOULIS G,DELEU G,DEMEESTER T,et al.Joint entity recognition and relation ex-traction as a multi-head selection problem[J].Expert Systems with Applications,2018,114:34-45.
[26]YU J T,BOHNET B,POESIO M.Named Entity Recognition as Dependency Parsing[DB/OL].(2020-06-13)[2023-08-22].https://arxiv.org/abs/2005.07150.
[1] PENG Bo, LI Yaodong, GONG Xianfu, LI Hao. Method for Entity Relation Extraction Based on Heterogeneous Graph Neural Networks and TextSemantic Enhancement [J]. Computer Science, 2024, 51(6A): 230700071-5.
[2] LU Liang, KONG Fang. Dialogue-based Entity Relation Extraction with Knowledge [J]. Computer Science, 2022, 49(5): 200-205.
[3] LI Bao-zhen, ZHANG Jin, WANG Bao-lu, YU Ping. Human-Object Interaction Recognition Integrating Multi-level Visual Features [J]. Computer Science, 2022, 49(11A): 220700012-8.
[4] ZHANG Shi-hao, DU Sheng-dong, JIA Zhen, LI Tian-rui. Medical Entity Relation Extraction Based on Deep Neural Network and Self-attention Mechanism [J]. Computer Science, 2021, 48(10): 77-84.
[5] YU Yi-lin, TIAN Hong-tao, GAO Jian-wei and WAN Huai-yu. Relation Extraction Method Combining Encyclopedia Knowledge and Sentence Semantic Features [J]. Computer Science, 2020, 47(6A): 40-44.
[6] ZHANG Jia-hui, CHEN Zhi-yuan, ZHAO Feng, AN Zhi-yong, XIE Qing-song. Stock Text Theme Recognition Based on Deep Fusion [J]. Computer Science, 2019, 46(11A): 122-126.
[7] YE Zhong-lin, JIA Zhen and YIN Hong-feng. Research on Multi-domain Natural Language Question Understanding [J]. Computer Science, 2017, 44(6): 216-221.
[8] LIU Kai, FU Hai-dong, ZOU Yu-wei and GU Jin-guang. Chinese Medical Weak Supervised Relation Extraction Based on Convolution Neural Network [J]. Computer Science, 2017, 44(10): 249-253.
[9] WAND Yuan XU De-zhi CHEN Jian-er. Entity Relation Extraction for Complex Chinese Text [J]. Computer Science, 2009, 36(8): 208-211.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!