Computer Science ›› 2023, Vol. 50 ›› Issue (10): 80-87.doi: 10.11896/jsjkx.230600036

• Granular Computing & Knowledge Discovery • Previous Articles     Next Articles

Novel Graph Convolutional Network Based on Multi-granularity Feature Fusion for Aspect-basedSentiment Analysis

DENG Ruhan1,2,3, ZHANG Qinghua2,3, HUANG Shuaishuai1,2,3, GAO Man1,2,3   

  1. 1 School of Computer Science and Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    2 Chongqing Key Laboratory of Computational Intelligence,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    3 Key Laboratory of Big Data Intelligent Computing,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2023-04-10 Revised:2023-06-05 Online:2023-10-10 Published:2023-10-10
  • About author:DENG Ruhan,born in 1999,postgra-duate.Her main research interests include granular computing and nutural language processing.ZHANG Qinghua,born in 1974,Ph.D,professor,Ph.D supervisor.His main research interests include rough sets,fuzzy sets,granular computing and uncertain information processing.
  • Supported by:
    National Natural Science Foundation of China(62276038),Talent Program Project of Chongqing(CQYC20210202215),Research Project on Teaching Reform of Graduate Education in Chongqing(YJG203079) and Major Project on Teaching Reform Research of Higher Education of Chongqing(201020).

Abstract: Aspect-based sentiment analysis(ABSA) is a fine-grained task in sentiment analysis that aims to detect the emotional polarity of aspects in given sentence.Due to the rise of deep learning and graph convolutional networks(GCNs),GCN constructed over dependency tree has been widely applied to ABSA and achieved satisfactory results.However,most studies only acquire the last layer node features of graph convolutional network(GCN) as input to the classifier,while ignoring other layer node features and GCNs have over-smoothing problem.In recent years,some researchers ensembled the multilayer node features of GCN,improving the performance of sentiment classification models.A model combines adaptively spatial feature fusion and highway networks,namely highway graph convolutional network based on multi-granularity feature fusion(MGFF-HGCN) is proposed for ABSA in this paper.First,this model constructs GCN by syntactic dependency structure and bidirectional context information,and highway networks is introduced for alleviating the deep GCN over-smoothing problem,deepening the depth of GCN.Then,a adaptive fusion mechanism is effectively employed to fuse the more comprehensive and multi-granularity node feature information obtained from various highway GCN(HGCN) layers.Finally,experimental results on public datasets show that the proposed method is comparable to the benchmark models and be able to capture more granular syntactic information and long-range dependencies relationship accurately.

Key words: Multi-granularity, Feature fusion, Graph convolutional networks, Highway networks, Aspect-based sentiment analysis

CLC Number: 

  • TP391
[1]D'ANIELLO G,GAETA M,LA ROCCA I.KnowMIS-ABSA:An overview and a reference model for applications of sentiment analysis and aspect-based sentiment analysis[J].Artificial Intelligence Review,2022,55(7):5543-5574.
[2]HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[3]CHEN P,SUN Z Q,BING L D,et al.Recurrent Attention Network on Memory for Aspect-basedSentiment Analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing(EMNLP).Stroudsburg,PA:ACL,2017:452-461.
[4]YANN L,LÉON B,YOSHUA B,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[5]VASWANI A,SHAZEER N,PARMAR N,et al.Attention Is All You Need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.Red Hook,NY:NIPS,2017:6000-6010.
[6]TANGD Y,QIN B,LIU T.Aspect Level Sentiment Classification with Deep Memory Network[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Proces-sing(EMNLP).Stroudsburg,PA:ACL,2016:214-224.
[7]HUANG B X,OU Y,CARLEY K M.Aspect Level SentimentClassification with Attention-over-attention Neural Networks[C]//International Conference on Social Computing,Behaviral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation.Berlin:Springer,2018:197-206.
[8]LIANG Y,MAO C S,LUO Y.Graph Convolutional Networksfor Text Classification[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.Menlo Park,CA:AAAI,2019:7370-7377.
[9]ZHANG C,LI Q C,SONG D W.Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).Stroudsburg,PA:ACL,2019:4567-4577.
[10]ZHANG M,QIAN T Y.Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ACL,2020:3540-3549.
[11]KIPF T N,WELLING M.Semi-supervised Classification withGraph Convolutional Networks[J/OL].https://arxiv.org/abs/1609.02907.pdf.
[12]SRIVASTAVA R K,GREFF K,SCHMIDHUBER J.HighwayNetworks[J/OL].https://arxiv.org/pdf/1505.00387.pdf.
[13]LI G H,MÜLLER M,QIAN G C,et al.Deepgcns:making gcns go as deep as cnns[J].arXiv:1904.03751.2019.
[14]PANG S G,YAN Z H,HUANG W H,et al.Highway-based Local Graph Convolution Network for Aspect-based Sentiment Analysis[C]//Natural Language Processing and Chinese Computing.Berlin:Springer,2021:544-556.
[15]PEDRYCZ W.Granular Computing:an Introduction[C]//Pro-ceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference(Cat.No.01TH8569).Piscataway:IEEE,2001:1349-1354.
[16]YAO Y Y.A triarchic theory of granular computing[J].Granular Computing,2016(1):145-157.
[17]WANG G Y,HU J,ZHANG Q H,et al.Granular Computing based Data Mining in the Views of Rough Set and Fuzzy Set[C]//2008 IEEE International Conference on Granular Computing.Piscataway:IEEE,2008:67-67.
[18]LIU S T,HUANG D,WANG Y H.Learning Spatial Fusion for Single-shot Object Detec-tion[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Los Alamitos,CA:IEEE Computer Society,2020:4016-4025.
[19]LIU S M,CHEN J H.A multi-label classification based ap-proach for sentiment classification[J].Expert Systems with Applications,2015,42(3):1083-1093.
[20]MULLEN T,COLLIER N.Sentiment Analysis using SupportVector Machines with Diverse Information Sources[C]//Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing(EMNLP).Barcelona,Spain:ACL,2004:412-418.
[21]TANG D Y,QIN B,FENG X C,et al.Effective Lstms for Target-dependent Sentiment Classification[C]//Proceedings of COLING 2016,the 26th International Conference on Computational Linguistics:Technical Papers.Berlin:COLING,2016:3298-3307.
[22]WANG Y Q,HUANG M L,ZHU X Y,et al. Attention-based Lstm for Aspect-level Sentiment Classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing(EMNLP).Stroudsburg,PA:ACL,2016:606-615.
[23]TAY Y,TUAN L A,HUI S C.Learning to Attend Via Word-aspect Associative Fusion for Aspect-based Sentiment Analysis[C]//Proceedings of the AAAI Conference on Artificial Intelligence.Menlo Park,CA:AAAI,2018:5956-5963.
[24]HU M T,ZHAO S W,GUO H L,et al.Learning to DetectOpinion Snippet for Aspect-based Sentiment Analysis[C]//Proceedings of the 23rd Conference on Computational Natural Language Learning(CoNLL).Stroudsburg,PA:ACL,2019:970-979.
[25]BECK D,HAFFARI G,COHN T.Graph-to-sequence Learning Using Gated Graph Neural Networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2018:273-283.
[26]SUN K,ZHANG R C,MENSAH S,et al.Aspect-level Sentiment Analysis Via Convolution over Dependency Tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).Stroudsburg,PA:ACL,2019:5679-5688.
[27]ZHU X F,ZHU L,GUO J F,et al.Gl-gcn:Global and local dependency guided graph convolutional networks for aspect-based sentiment classification[J].Expert Systems with Applications,2021,186:115712.
[28]HUANG B X,CARLEY K.Syntax-aware Aspect Level Senti-ment Classification with Graph Attention Networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International JointConfe-rence on Natural Language Processing(EMNLP-IJCNLP).Stroudsburg,PA:ACL,2019:5469-5477.
[29]WANG K,SHEN W Z,YANG Y Y,et al.Relational Graph Attention Network for Aspect-based Sentiment Analysis[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2020:3229-3238.
[30]LIANG B,SU H,YIN R D,et al.Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge[C]//Proceedings of the 2021 Conference onEmpirical Methods in Natural Language Processing(EMNLP).Stroudsburg,PA:ACL,2021:208-218.
[31]YU B G,ZHANG S W.A novel weight-oriented graph convolutional network for aspect-based sentiment analysis[J].The Journal of Supercomputing,2023,79(1):947-972.
[32]TIAN Y H,CHEN G M,SONG Y.Aspect-based SentimentAnalysis with Type-aware Graph Convolutional Networks and Layer Ensemble[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Stroudsburg,PA:ACL,2021:2910-2922.
[33]LI S,XU B,HAN Y K,et al.SS-GCN:Aspect-based Sentiment Analysis with Graph Convolutional Networks over Dependency Awareness[J].Computer Science,2023,50(3):3-11.
[34]DONG L,WEI F R,TAN C Q,et al.Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2014:49-54.
[35]PONTIKI M,GALANIS D,PAVLOPOULOS J,et al.SemEval-2014 Task 4:Aspect based Sentiment Analysis[C]//Procee-dings of the 8th International Workshop on Semantic Evaluation(SemEval 2014).Stroudsburg,PA:ACL,2014:27-35.
[36]PONTIKI M,GALANIS D,PAPAGEORGIOU H,et al.Semeval-2015 Task 12:Aspect based Sentiment Analysis[C]//Proceedings of the 9th international workshop on semantic evaluation(SemEval 2015).Stroudsburg,PA:ACL,2015:486-495.
[37]PONTIKI M,GALANIS D,PAPAGEORGIOU H,et al.Sem-Eval-2016 Task 5:Aspect based Sentiment Analysis[C]//Proceedings of the 10th International Workshop on Semantic Eva-luation(SemEVal-2016).Stroudsburg,PA:ACL,2016:9-30.
[38]PENNINGTON J,SOCHER R,MANNING C D.Glove:Global Vectors for Word Representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing(EMNLP).Stroudsburg,PA:ACL,2014:1532-1543.
[39]LI X,BING L D,LAM W,et al.Transformation Networks for Target-oriented Sentiment Classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2018:946-956.
[40]WANG X,LIU P,ZHU Z,et al.Aspect-based Sentiment Analysis with Graph Convolutional Networks over Dependency Awareness[C]//2022 26th International Conference on Pattern Recognition.Piscataway:IEEE,2022:2238-2245.
[1] CHEN Guojun, YUE Xueyan, ZHU Yanning, FU Yunpeng. Study on Building Extraction Algorithm of Remote Sensing Image Based on Multi-scale Feature Fusion [J]. Computer Science, 2023, 50(9): 202-209.
[2] ZHOU Fengfan, LING Hefei, ZHANG Jinyuan, XIA Ziwei, SHI Yuxuan, LI Ping. Facial Physical Adversarial Example Performance Prediction Algorithm Based on Multi-modal Feature Fusion [J]. Computer Science, 2023, 50(8): 280-285.
[3] SHAN Xiaohuan, SONG Rui, LI Haihai, SONG Baoyan. Event Recommendation Method with Multi-factor Feature Fusion in EBSN [J]. Computer Science, 2023, 50(7): 60-65.
[4] WANG Tianran, WANG Qi, WANG Qingshan. Transfer Learning Based Cross-object Sign Language Gesture Recognition Method [J]. Computer Science, 2023, 50(6A): 220300232-5.
[5] WU Liuchen, ZHANG Hui, LIU Jiaxuan, ZHAO Chenyang. Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion [J]. Computer Science, 2023, 50(6A): 220200096-7.
[6] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[7] DOU Zhi, HU Chenguang, LIANG Jingyi, ZHENG Liming, LIU Guoqi. Lightweight Target Detection Algorithm Based on Improved Yolov4-tiny [J]. Computer Science, 2023, 50(6A): 220700006-7.
[8] ZHANG Changfan, MA Yuanyuan, LIU Jianhua, HE Jing. Dual Gating-Residual Feature Fusion for Image-Text Cross-modal Retrieval [J]. Computer Science, 2023, 50(6A): 220700030-7.
[9] WANG Wei, BAI Long, MA Huanchang, LIU Yanheng. Study on Safety Warning Method of Driver’s Blind Area Based on Machine Vision [J]. Computer Science, 2023, 50(6A): 220700141-7.
[10] RUAN Wang, HAO Guosheng, WANG Xia, HU Xiaoting, YANG Zihao. Fusion Multi-feature Fuzzy Model for Target Recognition and Its Application [J]. Computer Science, 2023, 50(6A): 220100138-7.
[11] LI Yang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, GAO Xiang. Aspect-based Sentiment Analysis Based on Prompt and Knowledge Enhancement [J]. Computer Science, 2023, 50(6A): 220300279-7.
[12] LIU Zhe, LIANG Yudong, LI Jiaying. Adaptive Image Dehazing Algorithm Based on Dynamic Convolution Kernels [J]. Computer Science, 2023, 50(6): 200-208.
[13] JIA Tianhao, PENG Li. SSD Object Detection Algorithm with Residual Learning and Cyclic Attention [J]. Computer Science, 2023, 50(5): 170-176.
[14] YANG Ying, ZHANG Fan, LI Tianrui. Aspect-based Sentiment Analysis Based on Dual-channel Graph Convolutional Network with Sentiment Knowledge [J]. Computer Science, 2023, 50(5): 230-237.
[15] ZHANG Hu, ZHANG Guangjun. Document-level Event Extraction Based on Multi-granularity Entity Heterogeneous Graph [J]. Computer Science, 2023, 50(5): 255-261.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!