Computer Science ›› 2023, Vol. 50 ›› Issue (3): 307-314.doi: 10.11896/jsjkx.211200189

• Artificial Intelligence • Previous Articles     Next Articles

Sentiment Analysis of Chinese Short Text Combining Context and Dependent Syntactic Information

DU Qiming1,2, LI Nan1,2, LIU Wenfu1,2,3, YANG Shudan1,2, YUE Feng1,2   

  1. 1 School of Cyberspace Security Academy,Information Engineering University,Zhengzhou 450000,China
    2 State Key Laboratory of Mathematical Engineering and Advanced Computing,Information Engineering University,Zhengzhou 450000,China
    3 State Key Laboratory of Complex Electromagnetic Environment Effect on Electronic and Information System,Luoyang,Henan 471003,China
  • Received:2021-12-16 Revised:2022-04-21 Online:2023-03-15 Published:2023-03-15
  • About author:DU Qiming,born in 1998,postgraduate.His main research interests include big data analysis,natural language proces-sing and so on.
    LI Nan,born in 1977,Ph.D,associate professor.His main research interests include high-performance computing,big data analysis,big data security and so on.
  • Supported by:
    National Natural Science Foundation of China(61802433).

Abstract: Dependency parsing aims to analyze the syntactic structure of sentences from the perspective of linguistics.Existing studies suggest that combining such graph-like data with graph convolutional network(GCN) can help model better understand the text semantics.However,when dealing with dependency syntactic information as adjacency matrix,these methods ignore the types of syntactic dependency tags and the word semantics related to the tags,which makes the model unable to capture the deep emotional features.To solve the preceding problem,this paper proposes a Chinese short text sentiment analysis model CDSI(context and dependency syntactic information).This model can use BiLSTM(bidirectional long short-term memory) network to extract the context semantics of the text.Moreover,a dependency-aware embedding representation method is introduced to mine the contribution weights of different dependent paths to the sentiment classification task based on the syntactic structure.Then the GCN is used to model the context and dependent syntactic information at the same time,so as to strengthen the emotional features in the text representation.Based on SWB,NLPCC2014 and SMP2020-EWEC datasets,experimental results show that CDSI can effectively integrate the semantic and structural information in sentences,which achieves good results in both the Chinese short text sentiment binary classification and multi-classification tasks.

Key words: Syntactic structure, Context information, GCN, Chinese short text

CLC Number: 

  • TP391.1
[1]ZHANG Y,XU H,XU K.Chinese Short Text Classificationbased on Dependency Syntax Information[C]//ICCDA 2021:The 5th International Conference on Compute and Data Analysis.Sanya:ACM,2021:133-138.
[2]LI C B,DUAN Q J,JI C H,et al.Method of Short Text Classification Based on CHI and TF-IWF Feature Selection [J].Journal of Chongqing University of Technology(Natural Science),2021,35(5):135-140,222.
[3]QIU X,SUN T,XU Y,et al.Pre-trained Models for Natural Language Processing:Asurvey[J].Science China Technological Sciences,2020,63(10):1-26.
[4]KIM Y.Convolutional Neural Networks for Sentence Classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proceeding.Doha:ACL,2014:1746-1751.
[5]LENG X L,MIAO X A,LIU T.Using Recurrent Neural Network Structure with Enhanced Multi-Head Self-Attention for Sentiment Analysis[J].Multimedia Tools and Applications,2021,80(8):12581-12600.
[6]XU G,MENG Y,QIU X,et al.Sentiment Analysis of Comment Texts based on BiLSTM[J].IEEE Access,2019,7:51522-51532.
[7]XIAO H,XU S H.Analysis on Web Public Opinion Orientation based on Syntactic Parsing and Emotional Dictionary[J].Small Microcomputer System,2014,35(4):811-813.
[8]LI X H,GUO H,YAN H T.Micro-blog Sentiment Analysisbased on Improved DependencyParsing[J].Computer and Digi-tal Engineering,2017,45(3):506-511.
[9]WANG C,WANG B,XIANG W,et al.Encoding Syntactic Dependency and Topical Information for Social Emotion Classification[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.Paris:ACM,2019:881-884.
[10]TANG H,JI D,LI C,et al.Dependency Graph Enhanced Dual-Transformer Structure for Aspect-based Sentiment Classification[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Online:Association for Computational Linguistics,2020:6578-6588.
[11]ZHANG M,LI Z,FU G,et al.Dependency-based Syntax-Aware Word Representations[J].Artificial Intelligence,2021,292(4):103427.
[12]GUO Z,ZHANG Y,LU W.Attention Guided Graph Convolutional Networks for Relation Extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.Florence:Association for Computational Linguistics,2019:241-251.
[13]ZHANG B,ZHANG Y,WANG R,et al.Syntax-Aware Opinion Role Labeling with Dependency GraphConvolutional Networks[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Online:Association for Computational Linguistics,2020:3249-3258.
[14]WANG J H,WANG H H,WANG L.Dependency Parsing of Financial News to Improve Sentiment Analysis for Predicting Market Prices[C]//International Conference on Technologies and Applications of Artificial Intelligence.Taipei:IEEE,2020:1-7.
[15]ZHANG X S,GUO R Q,HUANG D G.Named Entity Recognition Based on Dependency[J].Journal of Chinese Information Processing,2021,35(6):63-73.
[16]KIPF T N,WELLING M.Semi-Supervised Classification withGraph Convolutional Networks[J].arXiv:1609.02907,2016.
[17]SUN K,ZHANG R C,MENSAH S,et al.Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Hong Kong:Association for Computational Linguistics,2019:5679-5688.
[18]LAI Y,ZHANG L,HAN D,et al.Fine-Grained Emotion Classification of ChineseMicroblogs based on Graph Convolution Networks[J].World Wide Web,2020,23(5):2771-2787.
[19]FAN T,WANG H,WU P.Sentiment Analysis of Online Users’ Negative Emotions based on GraphConvolutional Neural Network and Dependency Parsing [J].Data Analysis and Know-ledge Discovery,2021,5(9):97-106.
[20]PARK J,PARK C,KIM J,et al.ADC:Advanced DocumentClustering Using Contextualized Representations[J].Expert Systems with Applications,2019,137:157-166.
[21]CHE W,LI Z,LIU T.LTP:A Chinese Language Technology Platform[C]//COLING 2010,23rd International Conference on Computational Linguistics.Beijing:Demonstrations Volume,2010:13-16.
[22]MARCHEGGIANI D,TITOV I.Encoding Sentences withGraph Convolutional Networks for Semantic Role Labeling[C]//Proceedings of the 2017 Conference on Empirical Me-thods in Natural Language Processing.Copenhagen:Association for Computational Linguistics,2017:1506-1515.
[23]KARAMI M,MOSALLANEZHAD A,MANCENIDO M V,et al.“Let's Eat Grandma”:When Punctuation Matters in Sentence Representation for SentimentAnalysis[J].arXiv:2101.03029,2020.
[24]MIKOLOV T,SUTSKEVER I,CHEN K,et al.DistributedRepresentations of Words and Phrases and Their Compositio-nality[J].Advances in Neural Information Proces-sing Systems,2013,26(5):3111-3119.
[25]LI Y,DONG H B.Text Sentiment Analysis based on Feature Fusion of Convolution Neural Network and Bidirectional Long Short-Term Memory Network[J].Computer Applications,2018,38(11):3075-3080.
[1] KANG Yan, WU Zhi-wei, KOU Yong-qi, ZHANG Lan, XIE Si-yu, LI Hao. Deep Integrated Learning Software Requirement Classification Fusing Bert and Graph Convolution [J]. Computer Science, 2022, 49(6A): 150-158.
[2] SHAO Xin-xin. TI-FastText Automatic Goods Classification Algorithm [J]. Computer Science, 2022, 49(6A): 206-210.
[3] LIU Shuo, WANG Geng-run, PENG Jian-hua, LI Ke. Chinese Short Text Classification Algorithm Based on Hybrid Features of Characters and Words [J]. Computer Science, 2022, 49(4): 282-287.
[4] MIU Feng, WANG Ping, LI Tai-yong. Implicit Causality Extraction Method Based on Event Action Direction [J]. Computer Science, 2022, 49(3): 276-280.
[5] HAO Zhi-feng, LIAO Xiang-cai, WEN Wen, CAI Rui-chu. Collaborative Filtering Recommendation Algorithm Based on Multi-context Information [J]. Computer Science, 2021, 48(3): 168-173.
[6] YAN Xu, MA Shuai, ZENG Feng-jiao, GUO Zheng-hua, WU Jun-long, YANG Ping, XU Bing. Light Field Depth Estimation Method Based on Encoder-decoder Architecture [J]. Computer Science, 2021, 48(10): 212-219.
[7] NI Hai-qing, LIU Dan, SHI Meng-yu. Chinese Short Text Summarization Generation Model Based on Semantic-aware [J]. Computer Science, 2020, 47(6): 74-78.
[8] ZHOU Peng-cheng,GONG Sheng-rong,ZHONG Shan,BAO Zong-ming,DAI Xing-hua. Image Semantic Segmentation Based on Deep Feature Fusion [J]. Computer Science, 2020, 47(2): 126-134.
[9] XU Yang,WANG Jian-cheng,LIU Qi-yuan,LI Shou-shan. Intention Detection in Spoken Language Based on Context Information [J]. Computer Science, 2020, 47(1): 205-211.
[10] ZHAO Peng, WU Li-fa, HONG Zheng. Research on Broker Based Multicloud Access Control Model [J]. Computer Science, 2019, 46(11): 123-129.
[11] HAN Li , LIU Zheng-jie. CAUXT:A Tool to Help User Experience Researchers Capture Users’ Experience Data in Context of Interest [J]. Computer Science, 2018, 45(7): 278-285.
[12] WEN Jun-hao, SUN Guang-hui and LI Shun. Study on Matrix Factorization Recommendation Algorithm Based on User Clustering and Mobile Context [J]. Computer Science, 2018, 45(4): 215-219.
[13] LI Xiao, XIE Hui and LI Li-jie. Research on Sentence Semantic Similarity Calculation Based on Word2vec [J]. Computer Science, 2017, 44(9): 256-260.
[14] . Design of Intelligent Logistics System Based on Cloud Computing and Internet of Things [J]. Computer Science, 2012, 39(Z6): 212-213.
[15] HAN Yi,CAI Jian-hu,ZHOU Gen-gui, LI Yan-lai, MIAO Wei-nan. Research on Verification of RCWW Algorithm for Lot-sizing Planning Problem [J]. Computer Science, 2011, 38(8): 226-231.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!