Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 230200068-5.doi: 10.11896/jsjkx.230200068

• Artificial Intelligence • Previous Articles     Next Articles

Text Stance Detection Based on Topic Attention and Syntactic Information

KANG Shuming, ZHU Yan   

  1. School of Computing and Artificial Intelligence,Southwest Jiaotong University,Chengdu 611756,China
  • Published:2023-11-09
  • About author:KANG Shuming,born in 1998,postgraduate.His main research interests include stance detection and natural language processing.
    ZHU Yan,born in 1965,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include data mining,computational network analysis,and big data.
  • Supported by:
    Sichuan Science and Technology Project(2019YFSY0032).

Abstract: Text stance detection aims to infer users’ opinions on specific topics,such as supportive,opposing,neutral and other attitudes,from their published texts.Traditional stance detection studies often use deep learning models such as convolutional neural networks or long and short-term memory networks to learn the basic semantic information of the text,ignoring the syntactic structure information embedded in the text.To address this problem,this paper designs and implements a text stance detection model--AT-BiLSTM-GAT based on topic attention and dependent syntax,and on the basis of the text context information extracted by BiLSTM,GAT is used to further learn dependent syntactic information at the text linguistic level.Meanwhile,a topic attention mechanism incorporating contextual semantic information is designed and implemented,and scaled dot product attention is employed to learn the topic-related important content in stance text,and comparative experiments on public datasets prove the efficiency of the designed and implemented AT-BiLSTM-GAT model.Finally,to address the problem of the small size of the stance detection research dataset,a synonym replacement data enhancement scheme based on WordNet synonym database and WebVectors word embedding model-WWDA,which ensures the lexical correctness and semantic similarity of the synonym replacement process,and experiment proves that it can generate more high-quality samples and improve the detection performance of the model.

Key words: Stance detection, Topic attention, Dependency syntax, Graph attention network, Data augmentation

CLC Number: 

  • TP391
[1]LI Y,SUN Y Q,JING W P.Summary of Text Stance Detection[J].Journal of Computer Research and Development,2021,58(11):2538-2557.
[2]LIU W,PENG X,LI C,et al.A Survey on Stance Detection[J].Journal of Chinese Information,2020,34(12):1-8.
[3]DU J,XU R,HE Y,et al.Stance classification with target-specific neural attention networks[C]//International Joint Confe-rences on Artificial Intelligence.2017.
[4]YUE T C,ZHANG S W,YANG L,et al.A stance detectionmethod based on two-stage attention mechanism[J].Journal of Guangxi Normal University(Natural Science Edition),2019,37(1):42-49.
[5]BAI J,LI F,JI D H.Attention-based BiLSTM-CNN ChineseWeibo Stance Detection Model [J].Computer Applications and Software,2018,35(3):266r274.
[6]SUN Q,WANG Z,LI S,et al.Stance detection via sentiment information and neural network model[J].Frontiers of Computer Science,2019,13(1):127-138.
[7]WANG Z,SUN Q,LI S,et al.Neural Stance Detection WithHierarchical Linguistic Representations[J/OL].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2020,28.https://ieeexplore.ieee.org/abstract/document/8949710.
[8]WU L,CHEN Y,SHEN K,et al.Graph neural networks fornatural language processing:A survey[J].arXiv:2106.06090,2021.
[9]VELICKOVIC P,CUCURULL G,CASANOVA A,et al.Graph attention networks[J].arXiv:1710.10903,2017.
[10]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[J/OL].Advances in Neural Information Processing Systems,2017,30.https://proceedings.neurips.cc/paper_files/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html.
[11]MOHAMMAD S,KIRITCHENKO S,SOBHANI P,et al.Semeval-2016 task 6:Detecting stance in tweets[C]//Proceedings of the 10th international workshop on semantic evaluation(SemEval-2016).2016:31-41.
[12]GLANDT K,KHANAL S,LI Y,et al.Stance detection in COVID-19 tweets[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:1596-1611.
[13]WEI J,ZOU K.EDA:Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing(EMNLP-IJCNLP).2019:6382-6388.
[14]MILLER G A.WordNet:a lexical database for English[J].Communications of the ACM,1995,38(11):39-41.
[15]KUTUZOV A,FARES M,OEPEN S,et al.Word vectors,reuse,and replicability:Towards a community repository of large-text resources[C]//Proceedings of the 58th Conference on Si-mulation and Modelling.Linköping University Electronic Press,2017:271-276.
[1] XU Jie, WANG Lisong. Contrastive Clustering with Consistent Structural Relations [J]. Computer Science, 2023, 50(9): 123-129.
[2] LIANG Jiayin, XIE Zhipeng. Text Paraphrase Generation Based on Pre-trained Language Model and Tag Guidance [J]. Computer Science, 2023, 50(8): 150-156.
[3] YANG Zhizhuo, XU Lingling, Zhang Hu, LI Ru. Answer Extraction Method for Reading Comprehension Based on Frame Semantics and GraphStructure [J]. Computer Science, 2023, 50(8): 170-176.
[4] HUANG Fangwan, LU Juhong, YU Zhiyong. Data Augmentation for Cardiopulmonary Exercise Time Series of Young HypertensivePatients Based on Active Barycenter [J]. Computer Science, 2023, 50(6A): 211200233-11.
[5] ZHANG Tao, CHENG Yifei, SUN Xinxu. Graph Attention Networks Based on Causal Inference [J]. Computer Science, 2023, 50(6A): 220600230-9.
[6] ZENG Wu, MAO Guojun. Few-shot Learning Method Based on Multi-graph Feature Aggregation [J]. Computer Science, 2023, 50(6A): 220400029-10.
[7] WANG Qingyu, WANG Hairui, ZHU Guifu, MENG Shunjian. Study on SQL Injection Detection Based on FlexUDA Model [J]. Computer Science, 2023, 50(6A): 220600172-6.
[8] DONG Yongfeng, HUANG Gang, XUE Wanruo, LI Linhao. Graph Attention Deep Knowledge Tracing Model Integrated with IRT [J]. Computer Science, 2023, 50(3): 173-180.
[9] LU Qi, YU Yuanqiang, XU Daoming, ZHANG Qi. Improved YOLOv5 Small Drones Target Detection Algorithm [J]. Computer Science, 2023, 50(11A): 220900050-8.
[10] LUO Yuetong, LI Chao, DUAN Chang, ZHOU Bo. Hue Augmentation Method for Industrial Product Surface Defect Images [J]. Computer Science, 2023, 50(11A): 230200089-6.
[11] LIANG Lifang, GUAN Donghai, ZHANG Ji, YUAN Weiwei. Spatial-Temporal Attention Mechanism Based Anomaly Detection for Multivariate Times Series [J]. Computer Science, 2023, 50(11A): 230300022-8.
[12] WANG Chundong, DU Yingqi, MO Xiuliang, FU Haoran. Enhanced Federated Learning Frameworks Based on CutMix [J]. Computer Science, 2023, 50(11A): 220800021-8.
[13] LIU Nan, ZHANG Fengli, YIN Jiaqi, CHEN Xueqin, WANG Ruijin. Rumor Detection Model on Social Media Based on Contrastive Learning with Edge-inferenceAugmentation [J]. Computer Science, 2023, 50(11): 49-54.
[14] WU Yushan, XU Zengmin, ZHANG Xuelian, WANG Tao. Self-supervised Action Recognition Based on Skeleton Data Augmentation and Double Nearest Neighbor Retrieval [J]. Computer Science, 2023, 50(11): 97-106.
[15] TAN Ying-ying, WANG Jun-li, ZHANG Chao-bo. Review of Text Classification Methods Based on Graph Convolutional Network [J]. Computer Science, 2022, 49(8): 205-216.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!