计算机科学 ›› 2022, Vol. 49 ›› Issue (11): 206-211.doi: 10.11896/jsjkx.210900120

• 人工智能 • 上一篇    下一篇

基于多维语义映射的关系抽取方法研究

程华龄, 陈艳平, 杨卫哲, 秦永彬, 黄瑞章   

  1. 贵州大学计算机科学与技术学院 贵阳 550025
    公共大数据国家重点实验室 贵州大学计算机科学与技术学院 贵阳 550025
  • 收稿日期:2021-09-14 修回日期:2022-04-18 出版日期:2022-11-15 发布日期:2022-11-03
  • 通讯作者: 秦永彬(ybqin@foxmail.com)
  • 作者简介:(hlch.245@foxmail.com)
  • 基金资助:
    国家自然科学基金通用联合基金(U1836205);国家自然科学基金(62066007,62066008);贵州省科学技术基金重点(黔科合基础[2020]1Z055)

Relation Extraction Based on Multidimensional Semantic Mapping

CHENG Hua-ling, CHEN Yan-ping, YANG Wei-zhe, QIN Yong-bin, HUANG Rui-zhang   

  1. College of Computer Science and Technology,Guizhou University,Guiyang,550025,China
    State Key Laboratory of Public Big Data,College of Computer Science and Technology,Guizhou University,Guiyang 550025,China
  • Received:2021-09-14 Revised:2022-04-18 Online:2022-11-15 Published:2022-11-03
  • About author:CHENG Hua-ling,born in 1996,postgraduate.Her main research interests include natural language processing and relation extraction.
    QIN Yong-bin,born in 1980,Ph.D,professor.His main research interests include big data governance and application,and multi-source data fusion.
  • Supported by:
    State Key Program of the Joint Funds of National Natural Science of China(U1836205),National Natural Science Foundation of China(62066007,62066008) and Key Project of Guizhou Science and Technology Fund(Qian Ke He Ji Chu[2020]1Z055).

摘要: 关系抽取旨在从句子中识别出实体对之间的关系类型。在关系抽取领域,目前主流的方法都使用了深度学习方法,但大部分方法在输入层没有对词向量进行深层次的讨论。针对这一不足,提出了一种基于多维语义映射的关系抽取方法,该方法的核心思想是将矩阵降维方法应用于神经网络模型输入层。通过将表示文本的词向量进行多维度的降维分解,使分解后的词向量能映射表示同一语句在不同维度上的语义信息。实验结果表明,在Chinese Literature Text和SemEval-2010 Task8数据集上F1值分别达到了75.3%和88.9%,验证了所提方法的有效性。

关键词: 关系抽取, 神经网络, 多维映射, 语义信息

Abstract: Relation extraction aims to identify relation types between entities from texts.In the field of relation extraction,most of existing methods use deep learning methods,but they do not have in-depth discussion of word vectors in the input layer.To further exploit word vectors,this paper proposes a relation extraction method based on multi-dimensional semantic mapping.The core idea of the method is to reduce dimensionality of text feature matrix before the word vector enters the input layer.Experimental results show that the proposed method not only can reduce dimensionality effectively,but also can represent the semantic information of the same sentence in different dimensions,with its F1 of 75.3% and 88.9% on the Chinese Literature Text and SemEval-2010 Task8 datasets,respectively.

Key words: Relation extraction, Neural network, Multidimensional mapping, Semantic information

中图分类号: 

  • TP391
[1]KAMBHATLA N.Combining lexical,syntactic,and semanticfeatures with maximum entropy models for information extraction[C]//Proceedings of the ACL Interactive Poster and Demonstration Sessions.2004:178-181.
[2]BUNESCU R,MOONEY R.A shortest path dependency kernel for relation extraction[C]//Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing.2005:724-731.
[3]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018.
[4]XU J,WEN J,SUN X,et al.A discourse-level named entity reco-gnition and relation extraction dataset for chinese literature text[J].arXiv:1711.07010,2017.
[5]HENDRICKX I,KIM S N,KOZAREVA Z,et al.Semeval-2010 task 8:Multi-way classification of semantic relations between pairs of nominals[J].arXiv:1911.10422,2019.
[6]ZENG D,LIU K,LAI S,et al.Relation classification via convolutional deep neural network[C]//Proceedings of COLING 2014,the 25th International Conference on Computational Linguistics:Technical Papers.2014:2335-2344.
[7]LIU C Y,SUN W B,CHAO W H,et al.Convolution neural network for relation extraction[C]//International Conference on Advanced Data Mining and Applications.Berlin:Springer,2013:231-242.
[8]SANTOS C N D,XIANG B,ZHOU B.Classifying relations by ranking with convolutional neural networks[J].arXiv:1504.06580,2015.
[9]SOCHER R,HUVAL B,MANNING C D,et al.Semantic compositionality through recursive matrix-vector spaces[C]//Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning.2012:1201-1211.
[10]XU Y,MOU L,LI G,et al.Classifying relations via long short term memory networks along shortest dependency paths[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:1785-1794.
[11]CAI R,ZHANG X,WANG H.Bidirectional recurrent convolutional neural network for relation classification[C]//Procee-dings of the 54th Annual Meeting of the Association for Computational Linguistics.2016:756-765.
[12]CHEN Y P,WANG K,YANG W Z,et al.A Multi-Channel Deep Neural Network for Relation Extraction [J].IEEE Access,2020,8:13195-13203.
[13]VU N T,ADEL H,GUPTA P,et al.Combining recurrent and convolutional neural networks for relation classification[J].ar-Xiv:1605.07333,2016.
[14]LIU J,YANG Y,LV S,et al.Attention-based BiGRU-CNN for Chinese question classification[J].Journal of Ambient Intelligence and Humanized Computing,2019,1:1-12.
[15]ZHANG K,LV G,WU L,et al.Image-enhanced multi-level sentence representation net for natural language inference[C]//2018 IEEE International Conference on Data Mining(ICDM).IEEE,2018:747-756.
[16]ALT C,HÜBNER M,HENNIG L.Improving relation extraction by pre-trained language representations[J].arXiv:1906.03088,2019.
[17]GUO Z,ZHANG Y,LU W.Attention guided graph convolutional networks for relation extraction[J].arXiv:1906.07510,2019.
[18]LEI M,HUANG H,FENG C,et al.An input information enhanced model for relation extraction[J].Neural Computing and Applications,2019,31(12):9113-9126.
[19]SUN K,ZHANG R,MAO Y,et al.Relation extraction with convolutional network over learnable syntax-transport graph[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:8928-8935.
[20]WANG H,QIN K,LU G,et al.Direction-sensitive relation extraction using Bi-SDP attention model[J].Knowledge-Based Systems,2020,198:105928.
[21]LEE J,SEO S,CHOI Y S.Semantic relation classification via bidirectional lstm networks with entity-aware attention using latent entity typing[J].Symmetry,2019,11(6):785.
[1] 周芳泉, 成卫青.
基于全局增强图神经网络的序列推荐
Sequence Recommendation Based on Global Enhanced Graph Neural Network
计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[2] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[3] 宁晗阳, 马苗, 杨波, 刘士昌.
密码学智能化研究进展与分析
Research Progress and Analysis on Intelligent Cryptology
计算机科学, 2022, 49(9): 288-296. https://doi.org/10.11896/jsjkx.220300053
[4] 王润安, 邹兆年.
基于物理操作级模型的查询执行时间预测方法
Query Performance Prediction Based on Physical Operation-level Models
计算机科学, 2022, 49(8): 49-55. https://doi.org/10.11896/jsjkx.210700074
[5] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[6] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[7] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[8] 闫佳丹, 贾彩燕.
基于双图神经网络信息融合的文本分类方法
Text Classification Method Based on Information Fusion of Dual-graph Neural Network
计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042
[9] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[10] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[11] 齐秀秀, 王佳昊, 李文雄, 周帆.
基于概率元学习的矩阵补全预测融合算法
Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning
计算机科学, 2022, 49(7): 18-24. https://doi.org/10.11896/jsjkx.210600126
[12] 杨炳新, 郭艳蓉, 郝世杰, 洪日昌.
基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用
Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition
计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070
[13] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[14] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[15] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!