Computer Science ›› 2018, Vol. 45 ›› Issue (12): 130-136.doi: 10.11896/j.issn.1002-137X.2018.12.020

• Artificial Intelligence • Previous Articles     Next Articles

Selective Expression Approach Based on Event Trigger for Event Coreference Resolution on Twitter

WEI Ping1, CHAO Wen-han1, LUO Zhun-chen2, LI Zhou-jun1   

  1. (School of Computer Science and Engineering,Beihang University,Beijing 100191,China)1
    (Information Research Center of Military Science,PLA Academy of Military Science,Beijing 100142,China)2
  • Received:2018-01-24 Online:2018-12-15 Published:2019-02-25

Abstract: With the development and popularization of social media,how to recognize the coreference relation between two event mention in short texts is an urgent issue.In traditional researches about event coreference resolution,a rich set of linguistic features derived from pre-existing NLP tools and various knowledge bases is required,which restricts domain scalability and leads to the propagation of errors.To overcome these limitations,this paper proposed a novel selective expression approach based on event trigger to explore the coreference relationship on Twitter.Firstly,a bi-direction long short term memory (Bi-LSTM) is exploited to extract the features at sentence level and at mention level.Then,the latent features are generated by applying a gate on sentence level features to make it selectively express.Next,two auxiliary features named the overlapped words of trigger and time interval are designed.Finally,all these features are concatenated and fed into a simple classifier to predict the coreference relationship.In order to evaluate this method,this paper annotated a new dataset EventCoreOnTweet (ECT).The experimental results demonstrate that the selective expression approach significantly improves the performance of coreference resolution of short texts.

Key words: Event coreference resolution, Short text, Bi-direction long short-term memory, Neural networks

CLC Number: 

  • TP391
[1]BEJAN C A,HARABAGIU S.Unsupervised event coreference resolution with rich linguistic features[C]∥Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2010:1412-1422.
[2]HOVY E,MITAMURA T,VERDEJO F,et al.Events are not simple:Identity,non-identity,and quasi-identity.http://aclweb.org/anthology/w13-1203.
[3]ALLAN J.Topic Detection and Tracking Pilot Study :Final Report[C]∥Proceedings of DARPA Broadcast News Transcription and Understanding Workshop.1998:194-218.
[4]HUMPHREYS K,GAIZAUSKAS R,AZZAM S.Event corefe-rence for information extraction[C]∥A Workshop on Operatio-nal Factors in Practical,Robust Anaphora Resolution for Unrestricted Texts.Association for Computational Linguistics,1997:75-81.
[5]TELLEX S,KATZ B,LIN J,et al.Quantitative evaluation ofpassage retrieval algorithms for question answering[C]∥International ACM SIGIR Conference on Research and Development in Informaion Retrieval.ACM,2003:41-47.
[6]MCCARTHY D,CARROLL J.Disambiguating Nouns,Verbs,and Adjectives Using Automatically Acquired Selectional Pre-ferences.Computational Linguistics,2003,29(4):639-654.
[7]ZENG D,LIU K,LAI S,et al.Relation classification via convolutional deep neural network∥Proceedings of COLING 2014,the 25th International Conference on Computational Linguistics:Technical Papers.2014:2335-2344.
[8]NGUYEN T H,GRISHMAN R.Event Detection and Domain Adaptation with Convolutional Neural Networks∥Procee-dings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2:Short Papers).2015:365-371.
[9]CHEN Y,XU L,LIU K,et al.Event Extraction via DynamicMulti-Pooling Convolutional Neural Networks[C]∥The Mee-ting of the Association for Computational Linguistics.2015.
[10]KRAUSE S,XU F,USZKOREIT H,et al.Event Linking with Sentential Features from Convolutional Neural Networks[C]∥Signll Conference on Computational Natural Language Lear-ning.2016:239-249.
[11]HAGHIGHI A,DAN K.Coreference resolution in a modular,entity-centered model[C]∥Human Language Technologies:the 2010 Conference of the North American Chapter of the Association for Computational Linguistics.Association for Computational Linguistics,2010:385-393.
[12]RAHMAN A,NG V.Coreference Resolution with WorldKnowledge[C]∥The Meeting of the Association for Computational Linguistics:Human Language Technologies.2011:814-824.
[13]RAO D,MCNAMEE P,DREDZE M.Streaming Cross Docu-ment Entity Coreference Resolution[C]∥International Conference on Coling 2010.2010:1050-1058.
[14]MNIH V,HEESS N,Graves A.Recurrent models of visual attention∥Advances in neural information processing systems.2014:2204-2212.
[15]BAHDANAU D,CHO K,BENGIO Y.Neural machine translation by jointly learning to align and translate.arXiv preprint arXiv:1409.0473,2014.
[16]BAGGA A,BALDWIN B.Cross-document coreference:Annotations,Experiments,and Observations∥Proceedings of ACL-99 Workshop on Coreference and Its Applications.1999:1-8.
[17]CHEN Z,JI H,HARALICK R.A pairwise event coreferencemodel,feature impact and evaluation for event coreference resolution[C]∥The Workshop on Events in Emerging Text Types.Association for Computational Linguistics,2009:17-22.
[18]CHEN Z,JI H.Graph-based event coreference resolution[C]∥The Workshop on Graph-Based Methods for Natural Language Processing.Association for Computational Linguistics,2009:54-57.
[19]LIU Z,ARAKI J,HOVY E H,et al.Supervised Within-Docu-ment Event Coreference using Information Propagation.http://www.lrec-conf.org/proceedings/lrec 2014/pdf/646_paper.pdf.
[20]PENG H,SONG Y,DAN R.Event Detection and Co-reference with Minimal Supervision[C]∥Conference on Empirical Me-thods in Natural Language Processing.2016:392-402.
[21]TEH Y W,JORDAN M I,BEAL M J,et al.HierarchicalDirichlet Processes.Publications of the American Statistical Association,2006,101(476):1566-1581.
[22]GAEL J V,TEH Y W,GHAHRAMANI Z.The infinite facto-rial hidden Markov model[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.,2008:1697-1704.
[23]YANG B,CARDIE C,FRAZIER P.A Hierarchical Distance-dependent Bayesian Model for Event Coreference Resolution.arXiv:1504.05929,2015.
[24]BLEI D M,FRAZIER P I.Distance Dependent Chinese Restaurant Processes.Journal of Machine Learning Research,2011,12(1):2461-2488.
[25]LEE H,RECASENS M,CHANG A,et al.Joint entity and event coreference resolution across documents∥Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Lear-ning.Association for Computational Linguistics,2012:489-500.
[26]PRADHAN S S,RAMSHAW L,WEISCHEDEL R,et al.Unrestricted coreference:Identifying entities and events in OntoNotes∥International Conference on Semantic Computing.IEEE Computer Society,2007:446-453.
[27]ARAKI J,LIU Z,HOVY E H,et al.Detecting Subevent Structure for Event Coreference Resolution∥International Conference on Language Resource and Evaluation.2014:4553-4558.
[28]MIKOLOV T,SUTSKEVER I,CHEN K,et al.Distributed representations of words and phrases and their compositionality[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.,2013:3111-3119.
[29]HOCHREITER S,SCHMIDHUBER J.Long short-term memory.Neural Computation,1997,9(8):1735-1780.
[30]SUTSKEVER I,VINYALS O,LE Q V.Sequence to sequencelearning with neural networks∥Advances in neural information processing systems.2014:3104-3112.
[31]WU Y,SCHUSTER M,CHEN Z,et al.Google’s neural machine translation system:Bridging the gap between human and machine translation.arXiv preprint arXiv:1609.08144,2016.
[32]KINGMA D P,BA J.A method for stochastic optimization.arXiv preprint arXiv:1412.6980.2014.
[33]COHEN J.A coefficient of agreement for nominal scales.Educational & Psychological Measurement,2016,20(1):37-46.
[34]VILAIN M,BURGER J,ABERDEEN J,et al.A Model-Theoretic Coreferenc e Scoring Scheme[C]∥Conference on Message Understanding,Muc 1995,Columbia,Maryland,Usa,November.DBLP,1995:45-52.
[35]BAGGA A,BALDWIN B.Algorithms for scoring coreferencechains∥The First International Conference on Language Resources and Evaluation Workshop on Linguistics Corefe-rence.1998:563-566.
[36]RECASENS M,HOVY E.BLANC:Implementing the Rand index for coreference evaluation.Natural Language Enginee-ring,2011,17(4):485-510.
[37]LUO X.On coreference resolution performance metrics[C]∥HLT/EMNLP 2005,Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing,Proceedings of the Conference,Vancouver,British Columbia,Canada.DBLP,2005:25-32.
[38]PRADHAN S,LUO X,RECASENS M,et al.Scoring Corefe-rence Partitions of Predicted Mentions:A Reference Implementation[C]∥Meeting of the Association for Computational Linguistics.2014:30.
[1] ZHUANG Shi-jie, YU Zhi-yong, GUO Wen-zhong, HUANG Fang-wan. Short Term Load Forecasting via Zoneout-based Multi-time Scale Recurrent Neural Network [J]. Computer Science, 2020, 47(9): 105-109.
[2] ZHAO Qin-yan, LI Zong-min, LIU Yu-jie, LI Hua. Cascaded Siamese Network Visual Tracking Based on Information Entropy [J]. Computer Science, 2020, 47(9): 157-162.
[3] CHENG Jing, LIU Na-na, MIN Ke-rui, KANG Yu, WANG Xin, ZHOU Yang-fan. Word Embedding Optimization for Low-frequency Words with Applications in Short-text Classification [J]. Computer Science, 2020, 47(8): 255-260.
[4] SUN Yan-li, YE Jiong-yao. Convolutional Neural Networks Compression Based on Pruning and Quantization [J]. Computer Science, 2020, 47(8): 261-266.
[5] LI Ze-wen, LI Zi-ming, FEI Tian-lu, WANG Rui-lin and XIE Zai-peng. Face Image Restoration Based on Residual Generative Adversarial Network [J]. Computer Science, 2020, 47(6A): 230-236.
[6] DIAO Li and WANG Ning. Research on Premium Income Forecast Based on X12-LSTM Model [J]. Computer Science, 2020, 47(6A): 512-516.
[7] MA Hai-Jiang. Recommendation Algorithm Based on Convolutional Neural Network and Constrained Probability Matrix Factorization [J]. Computer Science, 2020, 47(6A): 540-545.
[8] NI Hai-qing, LIU Dan, SHI Meng-yu. Chinese Short Text Summarization Generation Model Based on Semantic-aware [J]. Computer Science, 2020, 47(6): 74-78.
[9] ZHUANG Zhi-gang, XU Qing-lin. Scene Graph Generation Model Combining Multi-scale Feature Map and Ring-type RelationshipReasoning [J]. Computer Science, 2020, 47(4): 136-141.
[10] PENG Xian, PENG Yu-xu, TANG Qiang, SONG Yan-qi. Crowd Counting Based on Single-column Multi-scale Convolutional Neural Network [J]. Computer Science, 2020, 47(4): 150-156.
[11] LIU Yu-hong,LIU Shu-ying,FU Fu-xiang. Optimization of Compressed Sensing Reconstruction Algorithms Based on Convolutional Neural Network [J]. Computer Science, 2020, 47(3): 143-148.
[12] LIU Xiao-ling,LIU Bai-song,WANG Yang-yang,TANG Hao. Research and Development of Multi-label Generation Based on Deep Learning [J]. Computer Science, 2020, 47(3): 192-199.
[13] HUANG Hong-wei,LIU Yu-jiao,SHEN Zhuo-kai,ZHANG Shao-wei,CHEN Zhi-min,GAO Yang. End-to-end Track Association Based on Deep Learning Network Model [J]. Computer Science, 2020, 47(3): 200-205.
[14] WANG Li-hua,DU Ming-hui,LIANG Ya-ling. Classification Net Based on Angular Feature [J]. Computer Science, 2020, 47(2): 83-87.
[15] FU Xue-yang,SUN Qi,HUANG Yue,DING Xing-hao. Single Image De-raining Method Based on Deep Adjacently Connected Networks [J]. Computer Science, 2020, 47(2): 106-111.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] . [J]. Computer Science, 2018, 1(1): 1 .
[2] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[3] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[4] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[5] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[6] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[7] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[8] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[9] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[10] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .