计算机科学 ›› 2022, Vol. 49 ›› Issue (10): 126-131.doi: 10.11896/jsjkx.220700064

• 数据库&大数据&数据科学 • 上一篇    下一篇

基于注意力机制交互卷积神经网络的推荐方法

任胜兰1, 郭慧娟2, 黄文豪3, 汤志宏4, 亓慧1   

  1. 1 太原师范学院计算机科学与技术学院 山西 晋中 030619
    2 太原理工大学信息与计算机学院 太原 030600
    3 华南理工大学软件学院 广州 510006
    4 江西科技学院信息工程学院 南昌 330098
  • 收稿日期:2022-07-06 修回日期:2022-08-24 出版日期:2022-10-15 发布日期:2022-10-13
  • 通讯作者: 任胜兰(250648099@qq.com)
  • 基金资助:
    山西省自然科学基金(201801D121147);山西省教育厅项目(2021YJJG269);山西省科技厅基础研究项目(自由探索)(20210302123334);江西省教育厅科学技术研究项目(GJJ191016)

Recommendation Method Based on Attention Mechanism Interactive Convolutional Neural Network

REN Sheng-lan1, GUO Hui-juan2, HUANG Wen-hao3, TANG Zhi-hong4, Qi Hui1   

  1. 1 College of Computer Science and Technology,Taiyuan Normal University,Jinzhong,Shanxi 030619,China
    2 College of Information and Computer,Taiyuan University of Technology,Taiguan 030600,China
    3 School of Software Engineering,South China University of Technology,Guangzhou 510006,China
    4 Information Engineering College,Jiangxi University of Technology,Nanchang 330098,China
  • Received:2022-07-06 Revised:2022-08-24 Online:2022-10-15 Published:2022-10-13
  • About author:REN Sheng-lan,born in 1962,undergraduate,associate professor.Her main research interests include artificial intelligence,big data and network secu-rity.
  • Supported by:
    Natural Science Foundation of Shanxi Province,China(201801D121147),Project of Shanxi Provincial Department of Education(2021YJJG269),Basic Research Project of Shanxi Provincial Department of Science and Technology(Free Exploration)(20210302123334) and Science and Technology Research Project of Jiangxi Provincial Department of Education(GJJ191016).

摘要: 为了捕捉在线购物时用户与商品之间的动态交互关系,提高推荐系统(RS)的准确度,提出了结合用户倾向性和商品吸引力的用户评价预测方法。首先,将评论分为用户评论文本和商品评论文本,分别输入两个交互卷积神经网络(CNN),并结合注意力机制,动态捕捉文本中的语义信息和上下文信息,得到用户和商品的自适应特征;然后,利用交互注意力网络,分析商品特征和用户特征的动态交互关系,计算出用户对特定商品的倾向性和商品对特定用户的吸引力;最后,通过预测模块提供用户对商品的准确评价预测。在数据集上进行实验,结果表明,所提方法取得了最优性能,比其他方法的MAE和RMSE性能分别至少提升了15.1%和13.6%。此外,基于Top-K的统计指标进一步验证了所提方法的商品推荐精准度。

关键词: 推荐系统, 用户倾向性, 卷积神经网络, 交互注意力机制, 上下文特征

Abstract: In order to capture the dynamic interaction between users and items during online shopping and improve the accuracy of recommendation systems(RS),a user rating prediction method combining user preference and item attractiveness is proposed.The reviews are divided into user review texts and product review texts,which are fed into two convolutional neural networks(CNN),and combined with an attention mechanism to dynamically capture semantic and contextual information in the texts,and obtain user and item adaptive representations.Subsequently,using the interactive attention network,the dynamic interaction between the item features and the user features is analyzed to calculate the user preference on specific items and the attractiveness of the items to a specific user.Finally,the prediction module is used to provide accurate predictions about user ratings to unseen items.Results on experimental datasets show that the proposed method achieves optimal performance,with at least 15.1% and 13.6% improvement in MAE and RMSE performance compared to other advanced methods.In addition,the statistical metrics based on Top-K further validate the accuracy of the proposed method for product recommendation.

Key words: Recommendation system, User preference, Convolutional neural network, Interactive-attention mechanism, Contextual features

中图分类号: 

  • TP391.41
[1]HUANG L W,JIANG B T,LYU S Y,et al.Survey on deeplearning based recommender systems[J].Chinese Journal of Computers,2018,41(7):1619-1647.
[2]KUMAR S,YADAVA M,ROY P P.Fusion of EEG response and sentiment analysis of products review to predict customer satisfaction[J].Information Fusion,2019,52(1):41-52.
[3]TANG L Y,XIONG C C,WANG Y,et al.Review of deep lear-ning for short text sentiment tendency analysis[J].Journal of Frontiers of Computer Science & Technology,2021,15(5):794-811.
[4]MAHADEVAN A,AROCK M.Integrated topic modeling and sentiment analysis:a review rating prediction approach for reco-mmender systems[J].Turkish Journal of Electrical Enginee-ring & Computer Sciences,2020,28(1):107-123.
[5]REN Y G,ZHANG Y P,ZHANG Z P.Collaborative filteringrecommendation algorithm based on rough set rule extraction[J].Journal on Communications,2020,41(1):76-83.
[6]CHENG Z,DING Y,ZHU L,et al.Aspect-aware latent factor model:Rating prediction with ratings and reviews[C]//Procee-dings of the 2018 World Wide Web Conference.Lyon,France:IEEE press,2018:639-648.
[7]DAU A,SALIM N.Recommendation system based on deeplearning methods:a systematic review and new directions[J].Artificial Intelligence Review,2020,53(4):2709-2748.
[8]LI S Z,YU L T,DENG X H.Recommendation model combining deep sentiment analysis and scoring matrix[J].Journal of Electronics & Information Technology,2022,44(1):245-253.
[9]SEO S,HUANG J,YANG H,et al.Interpretable convolutional neural networks with dual local and global attention for review rating prediction[C]//Proceedings of the Eleventh ACM Conference on Recommender Systems.Como,Italy:IEEE,2017:297-305.
[10]CHEN C,ZHANG M,LIU Y,et al.Neural attentional rating regression with review-level explanations[C]//International World Wide Web Conferences Steering Committee.Lyon,France:IEEE,2018:1583-1592.
[11]ZHENG L,NOROOZI V,YU P S.Joint deep modeling of users and items using reviews for recommendation[C]//Proceedings of the Tenth ACM International Conference on Web Search and Data Mining.Cambridge,United Kingdom:IEEE,2017:425-434.
[12]HYUN D,PARK C,CHO J,et al.Learning to utilize auxiliary reviews for recommendation[J].Information Sciences,2021,45(3):595-607.
[13]WANG R.Information fusion-based deep neural attentive ma-trix factorization recommendation[J].Algorithms,2021,14(10):281-297.
[14]WANG X L,YE D Y.Social media text classification methodbased on character-word feature self-attention learning[J].Pattern Recognition and Artificial Intelligence,2020,33(4):287-294.
[15]YE X,CAO J B,XU F X,et al.Sentiment dictionary adaptive learning method in Chinese domain[J].Computer Engineering and Design,2020,41(8):2231-2237.
[16]TU C,LIU H,LIU Z,et al.Cane:Context-aware network embedding for relation modeling[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.Vancouver,Canada:IEEE,2017:1722-1731.
[17]NORINDER U,NORINDER P.Predicting Amazon customer reviews with deep confidence using deep learning and conformal prediction[J].Journal of Management Analytics,2022,47(1):1-16.
[18]BUDHI G S,CHIONG R,PRANATA I,et al.Using machinelearning to predict the sentiment of online reviews:a new framework for comparative analysis[J].Archives of Computational Methods in Engineering,2021,28(4):2543-2566.
[19]KUMAR A,DEEPIKA R,KUMAR S,et al.Recommender System:An Automated Movie Rating Prediction Using an Improved Timefly Algorithm (ITFA)[J].Annals of the Romanian Society for Cell Biology,2021,39(2):1967-1971.
[20]HAN D,CHEN Y,ZHANG S.Implicit social recommendationalgorithm based on multilayer fuzzy perception similarity[J].International Journal of Machine Learning and Cybernetics,2022,13(2):357-369.
[1] 程章桃, 钟婷, 张晟铭, 周帆.
基于图学习的推荐系统研究综述
Survey of Recommender Systems Based on Graph Learning
计算机科学, 2022, 49(9): 1-13. https://doi.org/10.11896/jsjkx.210900072
[2] 王冠宇, 钟婷, 冯宇, 周帆.
基于矢量量化编码的协同过滤推荐方法
Collaborative Filtering Recommendation Method Based on Vector Quantization Coding
计算机科学, 2022, 49(9): 48-54. https://doi.org/10.11896/jsjkx.210700109
[3] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[4] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[5] 秦琪琦, 张月琴, 王润泽, 张泽华.
基于知识图谱的层次粒化推荐方法
Hierarchical Granulation Recommendation Method Based on Knowledge Graph
计算机科学, 2022, 49(8): 64-69. https://doi.org/10.11896/jsjkx.210600111
[6] 方义秋, 张震坤, 葛君伟.
基于自注意力机制和迁移学习的跨领域推荐算法
Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning
计算机科学, 2022, 49(8): 70-77. https://doi.org/10.11896/jsjkx.210600011
[7] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[8] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[9] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[10] 帅剑波, 王金策, 黄飞虎, 彭舰.
基于神经架构搜索的点击率预测模型
Click-Through Rate Prediction Model Based on Neural Architecture Search
计算机科学, 2022, 49(7): 10-17. https://doi.org/10.11896/jsjkx.210600009
[11] 齐秀秀, 王佳昊, 李文雄, 周帆.
基于概率元学习的矩阵补全预测融合算法
Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning
计算机科学, 2022, 49(7): 18-24. https://doi.org/10.11896/jsjkx.210600126
[12] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[13] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[14] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[15] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!