Computer Science ›› 2023, Vol. 50 ›› Issue (8): 37-44.doi: 10.11896/jsjkx.220600204

• Database & Big Data & Data Science • Previous Articles     Next Articles

Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism

ZHANG Yian1, YANG Ying2, REN Gang2, WANG Gang2   

  1. 1 School of Information Management,Nanjing University,Nanjing 210023,China
    2 School of Management,Hefei University of Technology,Hefei 230009,China
  • Received:2022-06-22 Revised:2022-11-04 Online:2023-08-15 Published:2023-08-02
  • About author:ZHANG Yian,born in 1999,postgra-duate.His main research interests include deep learning and user information behavior.
    WANG Gang,born in 1980,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include information systems and machine learning.
  • Supported by:
    National Natural Science Foundation of China(72071062,71471054,72071061).

Abstract: In the e-commerce era,online reviews are regarded as important product evaluations,which profoundly influence consumers' decision-making process.However,the exponentially increasing number of reviews and unstructured review data pose challenges to feature selection and accuracy improvement of review helpfulness prediction.In addition,current research mainly focuses on shallow features and feature extraction of review texts,the image information contained in review photos is often ignored.Besides,multi-modal information such as review text,photos,and shallow features needs to be refined and fused by app-lying multi-modal fusion methods.Based on these,this paper regards review photos and review text as a latent feature affecting the helpfulness of online reviews,and designs a shallow feature set according to the KAM knowledge adoption theory.For the data of three modalities,a deep prediction model,i.e.,three-modal review helpfulness prediction based on co-attention mechanism(TMCAM) is proposed,which can achieve the interaction and fusion of cross-modal information.The superior performance of the TMCAM model is tested through experiments,and it is proved that the complementation of image and text information can achieve better results than single modal information.Besides,shallow features can help predict the reviews helpfulness.Moreover,compared with simple modal features splicing,using collaborative attention mechanism for cross-modal information interaction helps to improve the perception of reviews helpfulness.

Key words: Review helpfulness, Co-attention mechanism, Multimodal fusion, Natural language processing, Deep learning

CLC Number: 

  • TP391.1
[1]HONG H,XU D,WANG G A,et al.Understanding the determinants of online review helpfulness:A meta-analytic investigation[J].Decision Support Systems,2017,102:1-11.
[2]KARIMI S,WANG F.Online review helpfulness:Impact of reviewer profile image[J].Decision Support Systems,2017,96:39-48.
[3]DU J,RONG J,MICHALSKA S,et al.Feature selection forhelpfulness prediction of online product reviews:An empirical study[J].PloS One,2019,14(12):e0226902.
[4]MUDAMBI S M,SCHUFF D.What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.com[J].MIS Quarterly,2010,34(1):185-200.
[5]SALEHAN M,KIM D J.Predicting the performance of online consumer reviews:A sentiment mining approach to big data analytics[J].Decision Support Systems,2016,81:30-40.
[6]CHATTERJEE S.Drivers of helpfulness of online hotel re-views:A sentiment and emotion mining approach[J].International Journal of Hospitality Management,2020,85:102356.
[7]PRIETO A,PRIETO B,ORTIGOSA E M,et al.Neural net-works:An overview of early research,current frameworks and new challenges[J].Neurocomputing,2016,214:242-268.
[8]SAUMYA S,SINGH J P,DWIVEDI Y K.Predicting the helpfulness score of online reviews using convolutional neural network[J].Soft Computing,2020,24(15):10989-11005.
[9]FAN M,FENG C,GUO L,et al.Product-Aware HelpfulnessPrediction of Online Reviews[C]//The World Wide Web Conference.2019.
[10]XU S,BARBOSA S E,HONG D.Bert feature based model for predicting the helpfulness scores of online customers reviews[C]//Future of Information and Communication Conference.Cham:Springer,2020:270-281.
[11]MA Y,XIANG Z,DU Q,et al.Effects of user-provided photos on hotel review helpfulness:An analytical approach with deep leaning[J].International Journal of Hospitality Management,2018,71:120-131.
[12]PAN Y,ZHANG J Q.Born unequal:a study of the helpfulness of user-generated product reviews[J].Journal of retailing,2011,87(4):598-612.
[13]LI M,HUANG L,TAN C H,et al.Helpfulness of online pro-duct reviews as seen by consumers:Source and content features[J].International Journal of Electronic Commerce,2013,17(4):101-136.
[14]LIU A X,LI Y,XU S X.Assessing the Unacquainted:Inferred Reviewer Personality and Review Helpfulness[J].MIS Quarterly,2021,45(3):1113-1148.
[15]REN G,HONG T.Examining the relationship between specific negative emotions and the perceived helpfulness of online reviews[J].Information Processing & Management,2019,56(4):1425-1438.
[16]MALIK M S I,HUSSAIN A.An analysis of review content and reviewer variables that contribute to review helpfulness[J].Information Processing & Management,2018,54(1):88-104.
[17]LEE S,CHOEH J Y.The determinants of helpfulness of online reviews[J].Behaviour & Information Technology,2016,35(10/11/12):853-863.
[18]DU J,RONG J,WANG H,et al.Neighbor-aware review helpfulness prediction[J].Decision Support Systems,2021,148:113581.
[19]LI H.Deep learning for natural language processing:advantages and challenges[J].National Science Review,2018,5(1):24-26.
[20]BRAUWERS G,FRASINCAR F.A General Survey on Attention Mechanisms in Deep Learning[J].IEEE Transactions on Knowledge and Data Engineering,2021,35(4):3279-3298.
[21]LU J,YANG J,BATRA D,et al.Hierarchical question-imageco-attention for visual question answering[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems.Cambridge:MIT Press,2016:289-297.
[22]YANG Z,HE X,GAO J,et al.Stacked attention networks for image question answering[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.2016:21-29.
[23]NAM H,HA J W,KIM J.Dual attention networks for multimodal reasoning and matching[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:299-307.
[24]KAZEMI V,ELQURSH A.Show,ask,attend,and answer:Astrong baseline for visual question answering[J].arXiv:1704.03162,2017.
[25]SUSSMAN S W,SIEGAL W S.Informational influence in organizations:An integrated approach to knowledge adoption[J].Information Systems Research,2003,14(1):47-65.
[26]SAUMYA S,SINGH J P,BAABDULLAH A M,et al.Ranking online consumer reviews[J].Electronic Commerce Research and Applications,2018,29:78-89.
[1] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[2] SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan. Review of Talking Face Generation [J]. Computer Science, 2023, 50(8): 68-78.
[3] WANG Xu, WU Yanxia, ZHANG Xue, HONG Ruize, LI Guangsheng. Survey of Rotating Object Detection Research in Computer Vision [J]. Computer Science, 2023, 50(8): 79-92.
[4] ZHOU Ziyi, XIONG Hailing. Image Captioning Optimization Strategy Based on Deep Learning [J]. Computer Science, 2023, 50(8): 99-110.
[5] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[6] LI Kun, GUO Wei, ZHANG Fan, DU Jiayu, YANG Meiyue. Adversarial Malware Generation Method Based on Genetic Algorithm [J]. Computer Science, 2023, 50(7): 325-331.
[7] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[8] SHEN Zhehui, WANG Kailai, KONG Xiangjie. Exploring Station Spatio-Temporal Mobility Pattern:A Short and Long-term Traffic Prediction Framework [J]. Computer Science, 2023, 50(7): 98-106.
[9] HUO Weile, JING Tao, REN Shuang. Review of 3D Object Detection for Autonomous Driving [J]. Computer Science, 2023, 50(7): 107-118.
[10] ZHOU Bo, JIANG Peifeng, DUAN Chang, LUO Yuetong. Study on Single Background Object Detection Oriented Improved-RetinaNet Model and Its Application [J]. Computer Science, 2023, 50(7): 137-142.
[11] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[12] LI Yuqiang, LI Linfeng, ZHU Hao, HOU Mengshu. Deep Learning-based Algorithm for Active IPv6 Address Prediction [J]. Computer Science, 2023, 50(7): 261-269.
[13] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[14] ZENG Wu, MAO Guojun. Few-shot Learning Method Based on Multi-graph Feature Aggregation [J]. Computer Science, 2023, 50(6A): 220400029-10.
[15] HOU Yanrong, LIU Ruixia, SHU Minglei, CHEN Changfang, SHAN Ke. Review of Research on Denoising Algorithms of ECG Signal [J]. Computer Science, 2023, 50(6A): 220300094-11.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!