Computer Science ›› 2025, Vol. 52 ›› Issue (7): 233-240.doi: 10.11896/jsjkx.240600144

• Artificial Intelligence • Previous Articles     Next Articles

Study on Opinion Summarization Incorporating Evaluation Object Information

KONG Yinling, WANG Zhongqing, WANG Hongling   

  1. School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
  • Received:2024-06-24 Revised:2024-09-20 Published:2025-07-17
  • About author:KONG Yinling,born in 2000,postgra-duate,is a member of CCF(No.L5741G).Her main research interests include text summarization and opinion summarization.
    WANG Hongling,born in 1975,assistant professor,is a member of CCF(No.14272M).Her main research interests include natural language processing and information retrieval.
  • Supported by:
    National Natural Science Foundation of China(61976146) and Young Scientists Fund of the National Natural Science Foundation of China(61806137).

Abstract: The opinion is a written form of consumer evaluation and feedback on a product.Opinion summarization refers to extracting and compressing a review to create a concise text that summarizes the information contained in the review.Currently,most opinion summarization tasks focus solely on the review text,without considering the evaluation object information within the review,such as aspects,opinion phrases,and sentiment polarities.Therefore,this paper proposes an opinion summarization me-thod based on the T5 model(Text-to-Text Transfer Transformer) incorporating the evaluation object information.The method first utilizes the T5 model to represent the task of opinion summarization.It learns contextual information from the review using the attention mechanism and generates a summary that encapsulates the core semantics.Then,it extracts the evaluation object information from the summary as an auxiliary task of opinion summarization.Finally,the model parameters are fine-tuned using a limited sample of data,which further enhances the summary generation process,resulting in a high-quality summary.Experimental results on both the hotel review dataset SPACE and the product review dataset OPOSUM+,show that the proposed method has a significant improvement in the ROUGE evaluation metrics compared to the baseline models.

Key words: Opinion summarization, T5 model, Evaluation object information, Limited sample data, Attention mechanism

CLC Number: 

  • TP391
[1]RAFFEL C,SHAZEER N,ROBERTS A,et al.Exploring the limits of transfer learning with a unified text-to-text transformer[J].Journal of Machine Learning Research,2020,21:5485-5551.
[2]CHU E,LIU P J.Meansum:A neural model for unsupervisedmulti-document abstractive summarization[C]//Proceedings of the 36th International Conference on Machine Learning.2019:1223-1232.
[3]BRAZINSKAS A,LAPATA M,TITOV I.Unsupervised opinion summarization as copycat-review generation[C]//Procee-dings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:5151-5169.
[4]ISO H,WANG X,SUHARA Y,et al.Convex aggregation foropinion summarization[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:3885-3903.
[5]ISONUMA M,MORI J,BOLLEGALA D,et al.Unsupervised abstractive opinion summarization by generating sentences with tree-structured topic guidance[J].Transactions of the Association for Computational Linguistics,2021,9:945-961.
[6]AMPLAYO R K,LAPATA M.Unsupervised opinion summarization with noising and denoising[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:1934-1945.
[7]MENG X,WEI F,LIU X,et al.Entity-centric topic-oriented opinion summarization in twitter[C]//Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Disco-very and Data Mining.2012:379-387.
[8]SHEN M,MA J,WANG S,et al.Simple yet effective synthetic dataset construction for unsupervised opinion summarization[C]//Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics.2023:1853-1866.
[9]SUHARA Y,WANG X,ANGELIDIS S,et al.Opiniondigest:A simple framework for opinion summarization[C]//Proceedings of the 58th Annual Meeting of the Association for Computa-tional Linguistics.2020: 5789-5798.
[10]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[11]ZHANG M,ZHOU G,HUANG N,et al.Asu-osum:Aspect-augmented unsupervised opinion summarization[J].Information Processing and Management,2023,60(1):103138.
[12]SILEDAR T,MAKWANA J,BHATTACHARYYA P.Aspect-sentiment-based opinion summarization using multiple information sources[C]//Proceedings of the 6th Joint International Conference on Data Science & Management of Data(10th ACM IKDD CODS and 28th COMAD).2023:55-61.
[13]LERMAN K,BLAIR-GOLDENSOHN S,MCDONALD R T.Sentiment summarization:Evaluating and learning user preferences[C]//Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics.2009:514-522.
[14]WANG K,WAN X.Transsum:Translating aspect and senti-ment embeddings for self-supervised opinion summarization[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:729-742.
[15]BHASKAR A,FABBRI A R,DURRETT G.Prompted opinion summarization with GPT-3.5[C]//Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics.2023:9282-9300.
[16]BROWN T B,MANN B,RYDER N,et al.Language Models are Few-Shot Learners[J].arXiv:2005.14165,2020.
[17]AMPLAYO R K,ANGELIDIS S,LAPATA M.Aspect-controllable opinion summarization[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:6578-6593.
[18]GLIWA B,MOCHOL I,BIESEK M,et al.SAMSum Corpus:A Human-annotated Dialogue Dataset for Abstractive Summarization[J].arXiv:1911.12237,2019.
[19]LEWIS M,LIU Y,GOYAL N,et al.BART:denoising sequence-to-sequence pre-training for natural language generation,translation,and comprehension[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:7871-7880.
[20]LIN C Y.Rouge:A package for automatic evaluation of summaries[C]//Text Summarization Branches Out.2004:74-81.
[21]ERKAN G,RADEVD R.Lexrank:Graph-based lexical centrality as salience in text summarization[J].Journal of Artificial Intelligence Research,2004,22:457-479.
[22]ANGELIDIS S,AMPLAYO R K,SUHARA Y,et al.Extractive opinion summarization in quantized transformer spaces[J].Transactions of the Association for Computational Linguistics,2021,9:277-293.
[1] LIU Yajun, JI Qingge. Pedestrian Trajectory Prediction Based on Motion Patterns and Time-Frequency Domain Fusion [J]. Computer Science, 2025, 52(7): 92-102.
[2] LIU Chengzhuang, ZHAI Sulan, LIU Haiqing, WANG Kunpeng. Weakly-aligned RGBT Salient Object Detection Based on Multi-modal Feature Alignment [J]. Computer Science, 2025, 52(7): 142-150.
[3] ZHUANG Jianjun, WAN Li. SCF U2-Net:Lightweight U2-Net Improved Method for Breast Ultrasound Lesion SegmentationCombined with Fuzzy Logic [J]. Computer Science, 2025, 52(7): 161-169.
[4] ZHENG Cheng, YANG Nan. Aspect-based Sentiment Analysis Based on Syntax,Semantics and Affective Knowledge [J]. Computer Science, 2025, 52(7): 218-225.
[5] WANG Youkang, CHENG Chunling. Multimodal Sentiment Analysis Model Based on Cross-modal Unidirectional Weighting [J]. Computer Science, 2025, 52(7): 226-232.
[6] ZENG Fanyun, LIAN Hechun, FENG Shanshan, WANG Qingmei. Material SEM Image Retrieval Method Based on Multi-scale Features and Enhanced HybridAttention Mechanism [J]. Computer Science, 2025, 52(6A): 240800014-7.
[7] HOU Zhexiao, LI Bicheng, CAI Bingyan, XU Yifei. High Quality Image Generation Method Based on Improved Diffusion Model [J]. Computer Science, 2025, 52(6A): 240500094-9.
[8] DING Xuxing, ZHOU Xueding, QIAN Qiang, REN Yueyue, FENG Youhong. High-precision and Real-time Detection Algorithm for Photovoltaic Glass Edge Defects Based onFeature Reuse and Cheap Operation [J]. Computer Science, 2025, 52(6A): 240400146-10.
[9] WANG Rong , ZOU Shuping, HAO Pengfei, GUO Jiawei, SHU Peng. Sand Dust Image Enhancement Method Based on Multi-cascaded Attention Interaction [J]. Computer Science, 2025, 52(6A): 240800048-7.
[10] WANG Baohui, GAO Zhan, XU Lin, TAN Yingjie. Research and Implementation of Mine Gas Concentration Prediction Algorithm Based on Deep Learning [J]. Computer Science, 2025, 52(6A): 240400188-7.
[11] LI Daicheng, LI Han, LIU Zheyu, GONG Shiheng. MacBERT Based Chinese Named Entity Recognition Fusion with Dependent Syntactic Information and Multi-view Lexical Information [J]. Computer Science, 2025, 52(6A): 240600121-8.
[12] HUANG Bocheng, WANG Xiaolong, AN Guocheng, ZHANG Tao. Transmission Line Fault Identification Method Based on Transfer Learning and Improved YOLOv8s [J]. Computer Science, 2025, 52(6A): 240800044-8.
[13] WU Zhihua, CHENG Jianghua, LIU Tong, CAI Yahui, CHENG Bang, PAN Lehao. Human Target Detection Algorithm for Low-quality Laser Through-window Imaging [J]. Computer Science, 2025, 52(6A): 240600069-6.
[14] GUAN Xin, YANG Xueyong, YANG Xiaolin, MENG Xiangfu. Tumor Mutation Prediction Model of Lung Adenocarcinoma Based on Pathological [J]. Computer Science, 2025, 52(6A): 240700010-8.
[15] TAN Jiahui, WEN Chenyan, HUANG Wei, HU Kai. CT Image Segmentation of Intracranial Hemorrhage Based on ESC-TransUNet Network [J]. Computer Science, 2025, 52(6A): 240700030-9.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!