Computer Science ›› 2024, Vol. 51 ›› Issue (3): 205-213.doi: 10.11896/jsjkx.230100035

• Artificial Intelligence • Previous Articles     Next Articles

Dual Feature Adaptive Fusion Network Based on Dependency Type Pruning for Aspect-basedSentiment Analysis

ZHENG Cheng1,2, SHI Jingwei1,2, WEI Suhua1,2, CHENG Jiaming1   

  1. 1 School of Computer Science and Technology,Anhui University,Hefei 230601,China
    2 Key Laboratory of Intelligent Computing & Signal Processing(Anhui University),Ministry of Education,Hefei 230601,China
  • Received:2023-01-06 Revised:2023-07-13 Online:2024-03-15 Published:2024-03-13
  • About author:ZHENG Cheng,born in 1964,Ph.D,associate professor.His main research interests include data mining and text analysis,and natural language proces-sing.
  • Supported by:
    Key Research and Development Project of Anhui Province(202004d07020009).

Abstract: Existing models use graph neural network based on dependency trees for aspect-based sentiment analysis,which improves the classification performanceof the model to a certain extent.However,due to technical limitations of dependency parsing,the inaccuracy of the dependency parsing results leads to a large amount of noise in the dependency tree,which makes the performance improvement of the model is limited.In addition,some sentences themselves do not conform to the standard syntactic structure.Previous studies utilized syntactic and semantic information with the same confidence level without fully considering the difference in their contributions to determining the polarity of aspect words,resulting in poor model performance on the corres-ponding datasets.To overcome these challenges,a dual feature adaptive fusion network based on dependency type pruning is proposed in this paper.Specifically,the model uses a novel hybrid approach,named dependency type pruning and adjacency matrix smoothing,to mitigate the noise generated by dependency parsing.In addition,the model fully considers the availability of syntactic information of sentences through a dual feature adaptive fusion module to combine syntactic features and semantic features for aspect-level sentiment analysis in a more flexible way.Extensive experiments on five publicly available datasets demonstrate that the proposed method significantly outperforms baseline models.

Key words: Aspect-based sentiment analysis, Graph neural networks, Dependency type pruning, Dual feature adaptive fusion, Deep learning, Natural language processing

CLC Number: 

  • TP391
[1]LIU J,TENG Z,CUI L,et al.Solving Aspect Category Senti-ment Analysis as a Text Generation Task[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.Stroudsburg:ACL,2021:4406-4416.
[2]LIN Y,FU Y,LI Y,et al.Aspect-based sentiment analysis for online reviews with hybrid attention networks[J].World Wide Web,2021,24(4):1215-1233.
[3]LI Y,WANG C,LIN Y,et al.Span-based relational graph transformer network for aspect-opinion pair extraction[J].Knowledge and Information Systems,2022,64(5):1305-1322.
[4]GAO L,WANG Y,LIU T,et al.Question-driven span labeling model for aspect-opinion pair extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2021:12875-12883.
[5]WU S,FEI H,REN Y,et al.Learn from Syntax:Improving Pair-wise Aspect and Opinion Terms Extraction with Rich Syntactic Knowledge[C]//Proceedings of the Thirtieth Interna-tional Joint Conference on Artificial Intelligence.San Francisco:Morgan Kaufmann,2021:3957-3963.
[6]LI Y,LIN Y,LIN Y,et al.A span-sharing joint extractionframework for harvesting aspect sentiment triples[J].Know-ledge-Based Systems,2022,242(2):108366.
[7]LIU Y,LIU Q,DAI D,et al.Unified Structure Generation forUniversal Information Extraction[C]//Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.Stroudsburg:ACL,2022:5755-5772.
[8]MAO Y,SHEN Y,YANG J,et al.Seq2path:Generating sentiment tuples as paths of a tree[C]//Findings of the Association for Computational Linguistics.Stroudsburg:ACL,2022:2215-2225.
[9]BAO X,WANG Z,JIANG X,et al.Aspect-based SentimentAnalysis with Opinion Tree Generation[C]//Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence.San Francisco:Morgan Kaufmann,2022:4044-4050.
[10]ZHANG C,LI Q,SONG D.Syntax-aware aspect-level sentiment classification with proximity-weighted convolution network[C]//Proceedings of the 42nd International ACM SIGIR Confe-rence on Research and De-velopment in Information Retrieval.New York:ACM,2019:1145-1148.
[11]ZHANG C,LI Q,SONG D.Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Stroudsburg:ACL,2019:4567-4577.
[12]WANG K,SHEN W,YANG Y,et al.Relational Graph Attention Network for Aspect-based Sentiment Analysis[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Stroudsburg:ACL,2020:3229-3238.
[13]CHEN J,HUANG Z,XUE Y.Bilateral-brain-like Semantic and Syntactic Cognitive Network for Aspect-level Sentiment Analysis[C]//2021 International Joint Conference on Neural Networks.Piscataway:IEEE,2021:1-8.
[14]PANG B,LEE L.Opinion Mining and Sentiment Analysis[J].Applied and Environmental Microbiology,2008,2(1/2):1-135.
[15]KIRITCHENKO S,ZHU X,CHERRY C,et al.NRC-Canada-2014:Detecting Aspects and Sentiment in Customer Reviews[C]//Proceedings of the 8th International Workshop on Semantic Evaluation.Stroudsburg:ACL,2014:437-442.
[16]MARCHEGGIANI D,TÄCKSTRÖM O,ESULI A,et al.Hie-rarchical multi-label conditional random fields for aspect-oriented opinion mining[C]//European Conference on Information Retrieval.Cham:Springer,2014:273-285.
[17]MNIH V,HEESS N,GRAVES A.Recurrent Models of Visual Attention[J].Advances in Neural Information Processing Systems,2014,27(2):2204-2212.
[18]WANG Y,HUANG M,ZHU X,et al.Attention-based LSTMfor Aspect-level Sentiment Classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.Stroudsburg:ACL,2016:606-615.
[19]LIU J,ZHANG Y.Attention modeling for targeted sentiment[C]//Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics.Stroudsburg:ACL,2017:572-577.
[20]FAN F,FENG Y,ZHAO D.Multi-grained attention network for aspect-level sentiment classification[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Stroudsburg:ACL,2018:3433-3442.
[21]BAO L,LAMBERT P,BADIA T.Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.Stroudsburg:ACL,2019:253-259.
[22]HE R,LEE W,NG H,et al.Effective Attention Modeling forAspect-Level Sentiment Classification[C]//Proceedings of the 27th International Conference on Computational Linguistics.Stroudsburg:ACL,2018:1121-1131.
[23]SUN K,ZHANG R,MENSAH S,et al.Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree[C]//Procee-dings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Stroudsburg:ACL,2019:5678-5687.
[24]HUANG B,CARLEY K M.Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing.Stroudsburg:ACL,2019:5468-5476.
[25]TIAN Y,CHEN G,SONG Y.Aspect-based Sentiment Analysis with Type-aware Graph Convolutional Networks and Layer Ensemble[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics.Stroudsburg:ACL,2021:2910-2922.
[26]HOU X,QI P,WANG G,et al.Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classification [C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics.Washington:NAACL,2021:2884-2894.
[27]LI R,CHEN H,FENG F,et al.Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.Stroudsburg:ACL,2021:6319-6329.
[28]PENNINGTON J,SOCHER R,MANNING C D.Glove:Global Vectors for Word Representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing.Stroudsburg:ACL,2014:1532-1543.
[29]KOTA V R,MUNISAMY S D.High accuracy offering attention mechanisms based deep learning approach using CNN/bi-LSTM for sentiment analysis[J].International Journal of Intelligent Computing and Cybernetics,2022,15(1):61-74.
[30]LIANG S,WEI W,MAO X L,et al.BiSyn-GAT+:Bi-SyntaxAware Graph Attention Network for Aspect-based Sentiment Analysis[C]//Findings of the Association for Computational Linguistics:ACL 2022.Stroudsburg:ACL,2022:1835-1848.
[31]LIU B,BEN A,GALDRAN A,et al.The Devil is in the Margin:Margin-based Label Smoothing for Network Calibration[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE,2022:80-88.
[32]LI Q,HAN Z,WU X,et al.Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning[C]//Procee-dings of the Thirty-Second AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2018:3538-3545.
[33]PONTIKI M,GALANIS D,PAVLOPOULOS J,et al.SemEval-2014 Task 4:Aspect Based Sentiment Analysis[C]//Procee-dings of the 8th International Workshop on Semantic Evaluation.Stroudsburg:ACL,2014:27-35.
[34]PONTIKI M,GALANIS D,PAPAGEORGOU H,et al.Semeval-2015 task 12:Aspect based sentiment analysis[C]//Proceedings of the 9th International Workshop on Semantic Evaluation.Stroudsburg:ACL,2015:486-495.
[35]PONTIKI M,GALANIS D,PAPAGEORGOU H,et al.Semeval-2016 task 5:Aspect based sentiment analysis[C]//Proceedings of the 10th International Workshop on Semantic Evaluation.Stroudsburg:ACL,2016:19-30.
[36]DONG L,WEI F,TAN C,et al.Adaptive Recursive Neural Network for Targetde-pendent Twitter Sentiment Classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.Stroudsburg:ACL,2014:49-54.
[37]MA D,LI S,ZHANG X,et al.Interactive Attention Networks for Aspect-Level Sentiment Classification[C]//Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence.San Francisco:Morgan Kaufmann,2017:4068-4074.
[38]HUANG B,OU Y,CARLEY K M.Aspect Level SentimentClassification with Attention-over-Attention Neural Networks[C]//International Conference on Social Computing,Behavioral-cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation.Cham:Springer,2018:197-206.
[39]ZHANG M,QIAN T.Convolution over Hierarchical Syntacticand Lexical Graphs for Aspect Level Sentiment Analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing.Association for Computational Linguistics.Stroudsburg:ACL,2020:3540-3549.
[40]BURSTEIN J,DORAN C,SOLORIO T,et al.BERT:Pre-trai-ning of Deep Bidirectional Transformers for Language Understanding [C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics.Stroudsburg:ACL,2019:4171-4186.
[1] CHEN Runhuan, DAI Hua, ZHENG Guineng, LI Hui , YANG Geng. Urban Electricity Load Forecasting Method Based on Discrepancy Compensation and Short-termSampling Contrastive Loss [J]. Computer Science, 2024, 51(4): 158-164.
[2] LIN Binwei, YU Zhiyong, HUANG Fangwan, GUO Xianwei. Data Completion and Prediction of Street Parking Spaces Based on Transformer [J]. Computer Science, 2024, 51(4): 165-173.
[3] SONG Hao, MAO Kuanmin, ZHU Zhou. Algorithm of Stereo Matching Based on GAANET [J]. Computer Science, 2024, 51(4): 229-235.
[4] XUE Jinqiang, WU Qin. Progressive Multi-stage Image Denoising Algorithm Combining Convolutional Neural Network and
Multi-layer Perceptron
[J]. Computer Science, 2024, 51(4): 243-253.
[5] ZHANG Mingdao, ZHOU Xin, WU Xiaohong, QING Linbo, HE Xiaohai. Unified Fake News Detection Based on Semantic Expansion and HDGCN [J]. Computer Science, 2024, 51(4): 299-306.
[6] TU Xin, ZHANG Wei, LI Jidong, LI Meijiao , LONG Xiangbo. Study on Automatic Classification of English Tense Exercises for Intelligent Online Teaching [J]. Computer Science, 2024, 51(4): 353-358.
[7] CHEN Jinyin, LI Xiao, JIN Haibo, CHEN Ruoxi, ZHENG Haibin, LI Hu. CheatKD:Knowledge Distillation Backdoor Attack Method Based on Poisoned Neuronal Assimilation [J]. Computer Science, 2024, 51(3): 351-359.
[8] HUANG Kun, SUN Weiwei. Traffic Speed Forecasting Algorithm Based on Missing Data [J]. Computer Science, 2024, 51(3): 72-80.
[9] XU Tianyue, LIU Xianhui, ZHAO Weidong. Knowledge Graph and User Interest Based Recommendation Algorithm [J]. Computer Science, 2024, 51(2): 55-62.
[10] HUANG Wenke, TENG Fei, WANG Zidan, FENG Li. Image Segmentation Based on Deep Learning:A Survey [J]. Computer Science, 2024, 51(2): 107-116.
[11] CAI Jiacheng, DONG Fangmin, SUN Shuifa, TANG Yongheng. Unsupervised Learning of Monocular Depth Estimation:A Survey [J]. Computer Science, 2024, 51(2): 117-134.
[12] ZHANG Feng, HUANG Shixin, HUA Qiang, DONG Chunru. Novel Image Classification Model Based on Depth-wise Convolution Neural Network andVisual Transformer [J]. Computer Science, 2024, 51(2): 196-204.
[13] WANG Yangmin, HU Chengyu, YAN Xuesong, ZENG Deze. Study on Deep Reinforcement Learning for Energy-aware Virtual Machine Scheduling [J]. Computer Science, 2024, 51(2): 293-299.
[14] HUANG Changxi, ZHAO Chengxin, JIANG Xiaoteng, LING Hefei, LIU Hui. Screen-shooting Resilient DCT Domain Watermarking Method Based on Deep Learning [J]. Computer Science, 2024, 51(2): 343-351.
[15] GE Huibin, WANG Dexin, ZHENG Tao, ZHANG Ting, XIONG Deyi. Study on Model Migration of Natural Language Processing for Domestic Deep Learning Platform [J]. Computer Science, 2024, 51(1): 50-59.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!