Computer Science ›› 2018, Vol. 45 ›› Issue (12): 130-136.doi: 10.11896/j.issn.1002-137X.2018.12.020

• Artificial Intelligence • Previous Articles     Next Articles

Selective Expression Approach Based on Event Trigger for Event Coreference Resolution on Twitter

WEI Ping1, CHAO Wen-han1, LUO Zhun-chen2, LI Zhou-jun1   

  1. (School of Computer Science and Engineering,Beihang University,Beijing 100191,China)1
    (Information Research Center of Military Science,PLA Academy of Military Science,Beijing 100142,China)2
  • Received:2018-01-24 Online:2018-12-15 Published:2019-02-25

Abstract: With the development and popularization of social media,how to recognize the coreference relation between two event mention in short texts is an urgent issue.In traditional researches about event coreference resolution,a rich set of linguistic features derived from pre-existing NLP tools and various knowledge bases is required,which restricts domain scalability and leads to the propagation of errors.To overcome these limitations,this paper proposed a novel selective expression approach based on event trigger to explore the coreference relationship on Twitter.Firstly,a bi-direction long short term memory (Bi-LSTM) is exploited to extract the features at sentence level and at mention level.Then,the latent features are generated by applying a gate on sentence level features to make it selectively express.Next,two auxiliary features named the overlapped words of trigger and time interval are designed.Finally,all these features are concatenated and fed into a simple classifier to predict the coreference relationship.In order to evaluate this method,this paper annotated a new dataset EventCoreOnTweet (ECT).The experimental results demonstrate that the selective expression approach significantly improves the performance of coreference resolution of short texts.

Key words: Bi-direction long short-term memory, Event coreference resolution, Neural networks, Short text

CLC Number: 

  • TP391
[1]BEJAN C A,HARABAGIU S.Unsupervised event coreference resolution with rich linguistic features[C]∥Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2010:1412-1422.
[2]HOVY E,MITAMURA T,VERDEJO F,et al.Events are not simple:Identity,non-identity,and quasi-identity.http://aclweb.org/anthology/w13-1203.
[3]ALLAN J.Topic Detection and Tracking Pilot Study :Final Report[C]∥Proceedings of DARPA Broadcast News Transcription and Understanding Workshop.1998:194-218.
[4]HUMPHREYS K,GAIZAUSKAS R,AZZAM S.Event corefe-rence for information extraction[C]∥A Workshop on Operatio-nal Factors in Practical,Robust Anaphora Resolution for Unrestricted Texts.Association for Computational Linguistics,1997:75-81.
[5]TELLEX S,KATZ B,LIN J,et al.Quantitative evaluation ofpassage retrieval algorithms for question answering[C]∥International ACM SIGIR Conference on Research and Development in Informaion Retrieval.ACM,2003:41-47.
[6]MCCARTHY D,CARROLL J.Disambiguating Nouns,Verbs,and Adjectives Using Automatically Acquired Selectional Pre-ferences.Computational Linguistics,2003,29(4):639-654.
[7]ZENG D,LIU K,LAI S,et al.Relation classification via convolutional deep neural network∥Proceedings of COLING 2014,the 25th International Conference on Computational Linguistics:Technical Papers.2014:2335-2344.
[8]NGUYEN T H,GRISHMAN R.Event Detection and Domain Adaptation with Convolutional Neural Networks∥Procee-dings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2:Short Papers).2015:365-371.
[9]CHEN Y,XU L,LIU K,et al.Event Extraction via DynamicMulti-Pooling Convolutional Neural Networks[C]∥The Mee-ting of the Association for Computational Linguistics.2015.
[10]KRAUSE S,XU F,USZKOREIT H,et al.Event Linking with Sentential Features from Convolutional Neural Networks[C]∥Signll Conference on Computational Natural Language Lear-ning.2016:239-249.
[11]HAGHIGHI A,DAN K.Coreference resolution in a modular,entity-centered model[C]∥Human Language Technologies:the 2010 Conference of the North American Chapter of the Association for Computational Linguistics.Association for Computational Linguistics,2010:385-393.
[12]RAHMAN A,NG V.Coreference Resolution with WorldKnowledge[C]∥The Meeting of the Association for Computational Linguistics:Human Language Technologies.2011:814-824.
[13]RAO D,MCNAMEE P,DREDZE M.Streaming Cross Docu-ment Entity Coreference Resolution[C]∥International Conference on Coling 2010.2010:1050-1058.
[14]MNIH V,HEESS N,Graves A.Recurrent models of visual attention∥Advances in neural information processing systems.2014:2204-2212.
[15]BAHDANAU D,CHO K,BENGIO Y.Neural machine translation by jointly learning to align and translate.arXiv preprint arXiv:1409.0473,2014.
[16]BAGGA A,BALDWIN B.Cross-document coreference:Annotations,Experiments,and Observations∥Proceedings of ACL-99 Workshop on Coreference and Its Applications.1999:1-8.
[17]CHEN Z,JI H,HARALICK R.A pairwise event coreferencemodel,feature impact and evaluation for event coreference resolution[C]∥The Workshop on Events in Emerging Text Types.Association for Computational Linguistics,2009:17-22.
[18]CHEN Z,JI H.Graph-based event coreference resolution[C]∥The Workshop on Graph-Based Methods for Natural Language Processing.Association for Computational Linguistics,2009:54-57.
[19]LIU Z,ARAKI J,HOVY E H,et al.Supervised Within-Docu-ment Event Coreference using Information Propagation.http://www.lrec-conf.org/proceedings/lrec 2014/pdf/646_paper.pdf.
[20]PENG H,SONG Y,DAN R.Event Detection and Co-reference with Minimal Supervision[C]∥Conference on Empirical Me-thods in Natural Language Processing.2016:392-402.
[21]TEH Y W,JORDAN M I,BEAL M J,et al.HierarchicalDirichlet Processes.Publications of the American Statistical Association,2006,101(476):1566-1581.
[22]GAEL J V,TEH Y W,GHAHRAMANI Z.The infinite facto-rial hidden Markov model[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.,2008:1697-1704.
[23]YANG B,CARDIE C,FRAZIER P.A Hierarchical Distance-dependent Bayesian Model for Event Coreference Resolution.arXiv:1504.05929,2015.
[24]BLEI D M,FRAZIER P I.Distance Dependent Chinese Restaurant Processes.Journal of Machine Learning Research,2011,12(1):2461-2488.
[25]LEE H,RECASENS M,CHANG A,et al.Joint entity and event coreference resolution across documents∥Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Lear-ning.Association for Computational Linguistics,2012:489-500.
[26]PRADHAN S S,RAMSHAW L,WEISCHEDEL R,et al.Unrestricted coreference:Identifying entities and events in OntoNotes∥International Conference on Semantic Computing.IEEE Computer Society,2007:446-453.
[27]ARAKI J,LIU Z,HOVY E H,et al.Detecting Subevent Structure for Event Coreference Resolution∥International Conference on Language Resource and Evaluation.2014:4553-4558.
[28]MIKOLOV T,SUTSKEVER I,CHEN K,et al.Distributed representations of words and phrases and their compositionality[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.,2013:3111-3119.
[29]HOCHREITER S,SCHMIDHUBER J.Long short-term memory.Neural Computation,1997,9(8):1735-1780.
[30]SUTSKEVER I,VINYALS O,LE Q V.Sequence to sequencelearning with neural networks∥Advances in neural information processing systems.2014:3104-3112.
[31]WU Y,SCHUSTER M,CHEN Z,et al.Google’s neural machine translation system:Bridging the gap between human and machine translation.arXiv preprint arXiv:1609.08144,2016.
[32]KINGMA D P,BA J.A method for stochastic optimization.arXiv preprint arXiv:1412.6980.2014.
[33]COHEN J.A coefficient of agreement for nominal scales.Educational & Psychological Measurement,2016,20(1):37-46.
[34]VILAIN M,BURGER J,ABERDEEN J,et al.A Model-Theoretic Coreferenc e Scoring Scheme[C]∥Conference on Message Understanding,Muc 1995,Columbia,Maryland,Usa,November.DBLP,1995:45-52.
[35]BAGGA A,BALDWIN B.Algorithms for scoring coreferencechains∥The First International Conference on Language Resources and Evaluation Workshop on Linguistics Corefe-rence.1998:563-566.
[36]RECASENS M,HOVY E.BLANC:Implementing the Rand index for coreference evaluation.Natural Language Enginee-ring,2011,17(4):485-510.
[37]LUO X.On coreference resolution performance metrics[C]∥HLT/EMNLP 2005,Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing,Proceedings of the Conference,Vancouver,British Columbia,Canada.DBLP,2005:25-32.
[38]PRADHAN S,LUO X,RECASENS M,et al.Scoring Corefe-rence Partitions of Predicted Mentions:A Reference Implementation[C]∥Meeting of the Association for Computational Linguistics.2014:30.
[1] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[2] LYU Xiao-feng, ZHAO Shu-liang, GAO Heng-da, WU Yong-liang, ZHANG Bao-qi. Short Texts Feautre Enrichment Method Based on Heterogeneous Information Network [J]. Computer Science, 2022, 49(9): 92-100.
[3] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[6] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[7] SHAO Xin-xin. TI-FastText Automatic Goods Classification Algorithm [J]. Computer Science, 2022, 49(6A): 206-210.
[8] ZHANG Hong-min, LI Ping-ping, FANG Xiao-bing, LIU Hong. Human Abnormal Behavior Detection Method Based on Improved YOLOv3 Network Model [J]. Computer Science, 2022, 49(4): 233-238.
[9] LIU Shuo, WANG Geng-run, PENG Jian-hua, LI Ke. Chinese Short Text Classification Algorithm Based on Hybrid Features of Characters and Words [J]. Computer Science, 2022, 49(4): 282-287.
[10] LI Yong, WU Jing-peng, ZHANG Zhong-ying, ZHANG Qiang. Link Prediction for Node Featureless Networks Based on Faster Attention Mechanism [J]. Computer Science, 2022, 49(4): 43-48.
[11] ZHANG Hu, BAI Ping. Graph Convolutional Networks with Long-distance Words Dependency in Sentences for Short Text Classification [J]. Computer Science, 2022, 49(2): 279-284.
[12] CHEN Zhi-yi, SUI Jie. DeepFM and Convolutional Neural Networks Ensembles for Multimodal Rumor Detection [J]. Computer Science, 2022, 49(1): 101-107.
[13] FAN Hong-jie, LI Xue-dong, YE Song-tao. Aided Disease Diagnosis Method for EMR Semantic Analysis [J]. Computer Science, 2022, 49(1): 153-158.
[14] WANG Chao, WEI Xiang-lin, TIAN Qing, JIAO Xiang, WEI Nan, DUAN Qiang. Feature Gradient-based Adversarial Attack on Modulation Recognition-oriented Deep Neural Networks [J]. Computer Science, 2021, 48(7): 25-32.
[15] SHI Wei, FU Yue. Microblog Short Text Mining Considering Context:A Method of Sentiment Analysis [J]. Computer Science, 2021, 48(6A): 158-164.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!