Computer Science ›› 2023, Vol. 50 ›› Issue (12): 255-261.doi: 10.11896/jsjkx.221000214

• Artificial Intelligence • Previous Articles     Next Articles

Chinese Implicit Sentiment Classification Combining Multiple Linguistic Features

LU Liangqian, WANG Zhongqing, ZHOU Guodong   

  1. School of Computer Science and Technology,Soochow University,Suzhou,Jiangsu 215006,China
  • Received:2022-10-25 Revised:2023-03-05 Online:2023-12-15 Published:2023-12-07
  • About author:LU Liangqian,born in 1998,postgra-duate,is a member of China Computer Federation.Her main research interest is natural language processing.
    WANG Zhongqing,born in 1987,Ph.D,associate professor,is a member of China Computer Federation.His main research interest is natural language processing.
  • Supported by:
    National Natural Science Foundation of China(62076175,61976146).

Abstract: Sentiment analysis has always been a hot research direction in natural language processing.Implicit sentiment classification refers to the task of sentiment classification without explicit sentiment words.At present,implicit sentiment analysis is still in its infancy.Implicit sentiment analysis is faced with problems such as lack of explicit sentiment words,euphemism of expression,and difficulty in understanding semantics.Traditional sentiment analysis methods,such as sentiment dictionary and bag-of-word models,are difficult to be effective,making the task of implicit sentiment classification more difficult.To solve the above problems,this paper proposes a graph neural network model that combines text,part-of-speech tags and dependency to perform implicit sentiment classification.Specifically,the model first extracts part of speech and dependency features of the text,and then uses pre-training language model BERT to extract text vector features,thus builds a graph attention neural network based on multiple linguistic features.The model has been tested on SMP2021 implicit sentiment recognition public dataset for several times.Experimental results show that the proposed model achieves the best results compared with multiple baseline models.The proposed implicit sentiment classification method is feasible and effective.

Key words: Implicit sentiment classification, Part-of-speech tagging, Dependency analysis, Graph model, BERT, Linguistic features

CLC Number: 

  • TP391
[1]YGNG L G,ZHU J,TANG S P.Review of text emotion analysis[J].Computer Applications,2013,33(6):1574-1578.
[2]LIU B.Sentiment analysis and opinion mining[M].Americal:Morgan & Claypool Publishers,2012.
[3]LIAO J,WANG S G,LI D Y.Identification of fact-implied implicit sentiment based on multi-level semantic fused representation[J].Knowledge-Based Systems,2019,165(1):197-207.
[4]JIAN L,YANG L,WANG S G.The constitution of a fine-grained opinion annotated corpus on weibo[C]//Lecture Notes in Artificial Intelligence Volume.2016:227-240.
[5]YUAN J L,DING Y,PAN D X,et al.Chinese implicit emotion classification model based on temporal and contextual features[J].Computer Applications,2021,41(10):2820-2828.
[6]ZHAO L G.Sentence level fine-grained affective computingbased on dependency syntax[D].Guangzhou:South China University of Technology,2015.
[7]LIAO J.Research on fact-based implicit affective an-a lysisbased on representation learning[D].Taiyuan:Shanxi University,2018.
[8]GUO F R,HUANG X X,WANG R B,et al.Metaphor recognition based on transformer and graph convolution neural network[J].Data Analysis and Knowledge Discovery,2022,6(4):120-129.
[9]ZHANG W,WANG H,CHEN Y T,et al.Research on know-ledge recognition and relevance of Chinese idiom metaphor integrating transfer learning and text enhancement[J].Data Ana-lysis and Knowledge Discovery,2022,6(Z1):167-183.
[10]HUANG H Y,LIU X,LIU Q.Text metaphor recognition graph coding method based on knowledge enhancement[J].Computer Research and Development,2023(1):140-152.
[11]BHATTASALI S,CYTRYN J,FELDMAN E,et al.Automatic identification of rhetorical questions[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.2015:743-749.
[12]WEN Z.Research on rhetorical question recognition and emotion discrimination based on depth learning[D].Shanxi:Shanxi University,2019.
[13]LI Y,WU Z J,WANG S G,et al.A rhetorical question recognition method based on automatic acquisition of linguistic features[J].Journal of Chinese Information Science,2020,34(2):96-104.
[14]SUN X,HE J J,REN F J.Satirical pragmatic discriminationbased on hybrid neural network model of multi feature fusion[J].Journal of Chinese Information,2016,30(6):215-223.
[15]LU X.Research on Chinese Irony Recognition and EmotionalDiscrimination Based on Deep Learning[D].Shanxi:Shanxi University,2019.
[16]LUO G Z,ZHAO Y Y,QIN B,et al.Irony Recognition for Social Media[J].Intelligent Computers and Applications,2020,10(2):301-307.
[17]LI Z Y,ZOU Y C,ZHANG C,et al.Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:246-256.
[18]ZHOU D Y,WANG J N,ZHANG L H,et al.Implicit Sentiment Analysis with Event-Centered Text Representation[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:6884-6893.
[19]YANG S L,CHANG Z.Chinese implicit emotion analysis based on graph attention neural network[J].Computer Engineering and Application,2021,57(24):161-167.
[20]HUANG S C,HAN D H,QIAO B Y,et al.An implicit emotion analysis method based on ERNIE2.0-BiLSTM-Attention[J].Small Microcomputer System,2021,42(12):2485-2489.
[21]CHEN Q C,ZHAO H,ZUO E G,et al.Implicit emotion analysis based on context aware tree recurrent neural network[J].Computer Engineering and Application,2022,58(7):167-175.
[22]YUAN J L,DING Y,PAN D X,et al.Chinese implicit emotion classification model based on temporal and contextual features[J].Computer Applications,2021,41(10):2820-2828.
[23]CHEN M,UBUL K,XU X,et al.Connecting Text Classification with Image Classification:A New Preprocessing Method for Implicit Sentiment Text Classification[J].Sensors(Basel),2022,22(5):1899.
[24]ZHUANG Y,LIU Z,LIU T T,et al.Implicit sentiment analysis based on multi-feature neural network model[J].Journal Information,2022,26(2):635-644.
[25]SUN Y,WANG S,LI Y K,et al.Ernie2.0:understanding a continuous language pre training framework[C]//AAAI Artificial Intelligence Conference.2020:8968-8975.
[26]DEVLIN J,CHANG M W,LEE K,et al.Bert:pre-training of deep bidirectional transformers for language understanding[C]//The 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Association for Computational Linguistics,2019:4171-4186.
[27]VELIČKOVIĆ P,CUCURULL G,CASANOVA A,et al.Graph attention networks[C]//The 6th International Conference on Learning Representations.2018:1-12.
[28]ARMAD J.Bag of Tricks for Efficient Text Classification[DB/OL].(2016-8-9).[2023-3-20].https://arxiv.org/abs/1607.01759.
[29]RIE J,TONG Z.Deep Pyramid Convolutional Neural Networks for Text Categorization[C]//Annual Meeting of the Association for Computational Linguistics(ACL).2017.
[30]YOON K.Convolutional neural networks for sentence classification[C]//Conference on Empirical Methods in Natural Language Processing.2014:1746-1751.
[31]YANG L,WU Y G,WANG J L,et al.Review of research on cyclic neural networks[J].Computer Applications,2018,38(S2):1-6,26.
[32]SUN Y,WANG S,LI Y,et al.ERNIE:Enhanced Representation through Knowledge Integration[J].arXiv:1904.09223,2019.
[33]SONG Y,WANG J,TAO J,et al.Attentional Encoder Network for Targeted Seniment Classification[J].arXiv:1902.09314,2019.
[1] LIU Yingying, YANG Qiuhui, YAO Bangguo, LIU Qiaoyun. Study on REST API Test Case Generation Method Based on Dependency Model [J]. Computer Science, 2023, 50(9): 101-107.
[2] HENG Hongjun, MIAO Jing. Fusion of Semantic and Syntactic Graph Convolutional Networks for Joint Entity and Relation Extraction [J]. Computer Science, 2023, 50(9): 295-302.
[3] ZHAO Jiangjiang, WANG Yang, XU Yingying, GAO Yang. Extractive Automatic Summarization Model Based on Knowledge Distillation [J]. Computer Science, 2023, 50(6A): 210300179-7.
[4] LI Binghui, FANG Huan, MEI Zhenhui. Interpretable Repair Method for Event Logs Based on BERT and Weak Behavioral Profiles [J]. Computer Science, 2023, 50(5): 38-51.
[5] LUO Liang, CHENG Chunling, LIU Qian, GUI Yaocheng. Answer Selection Model Based on MLP and Semantic Matrix [J]. Computer Science, 2023, 50(5): 270-276.
[6] WANG Yali, ZHANG Fan, YU Zeng, LI Tianrui. Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network [J]. Computer Science, 2023, 50(4): 196-203.
[7] DENG Liang, QI Panhu, LIU Zhenlong, LI Jingxin, TANG Jiqiang. BGPNRE:A BERT-based Global Pointer Network for Named Entity-Relation Joint Extraction Method [J]. Computer Science, 2023, 50(3): 42-48.
[8] LIU Zhe, YIN Chengfeng, LI Tianrui. Chinese Spelling Check Based on BERT and Multi-feature Fusion Embedding [J]. Computer Science, 2023, 50(3): 282-290.
[9] CHEN Shifei, LIU Dong, JIANG He. CodeBERT-based Language Model for Design Patterns [J]. Computer Science, 2023, 50(12): 75-81.
[10] YANG Jincai, MA Chen, XIAO Ming. Relation Recognition of Unmarked Complex Sentences Based on Feature Fusion [J]. Computer Science, 2023, 50(11A): 221100065-6.
[11] WANG Zhiming, ZHENG Kai. Joint Method for Spoken Language Understanding Based on BERT and Multiple Feature Gate Mechanism [J]. Computer Science, 2023, 50(11A): 230300002-6.
[12] QIAN Taiyu, CHEN Yifei, PANG Bowen. Audit Text Named Entity Recognition Based on MacBERT and Adversarial Training [J]. Computer Science, 2023, 50(11A): 230200083-6.
[13] LIN Zhengchao, LI Bicheng. Aspect-based Sentiment Analysis Based on Local Context Focus Mechanism and Talking-Head Attention [J]. Computer Science, 2023, 50(11A): 220900266-6.
[14] JIA Jingdong, ZHANG Minnan, ZHAO Xiang, HUANG Jian. Study on Scheduling Algorithm of Intelligent Order Dispatching [J]. Computer Science, 2023, 50(11A): 230300029-7.
[15] YU Jia-qi, KANG Xiao-dong, BAI Cheng-cheng, LIU Han-qing. New Text Retrieval Model of Chinese Electronic Medical Records [J]. Computer Science, 2022, 49(6A): 32-38.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!