融合node2vec和深度神经网络的隐式反馈推荐模型

doi:10.11896/j.issn.1002-137X.2019.06.005

摘要/Abstract

摘要： 利用隐式反馈信息实现个性化推荐是实用且具有挑战性的研究课题。对如何有效结合辅助信息来解决数据稀疏问题从而实现高效推荐的问题进行了研究,提出了一种融合node2vec和深度神经网络的隐式反馈推荐模型。该模型采用一种嵌入元数据的深度神经网络框架(Deep Neural Network Framework with Embedded Meta-data,Meta-DNN),首先将用户和项目的one-hot向量进行低维映射,再嵌入元数据信息,并结合node2vec的二阶随机游走方法学习网络中的邻居节点,使得相邻节点具有相似的节点表示,同时通过增强相邻用户和项目的平滑度来缓解数据稀疏性;最后使用深度神经网络进一步学习用户对项目的偏好,进而为用户产生推荐。其中,还引入了流行度参数对未知项目进行非平均抽样,优化隐式反馈负采样策略。在Gowalla和MovieLens-1M两个数据集上的实验表明,所提方法可以明显提高系统的预测性能和推荐质量。

关键词: node2vec, 深度学习, 神经网络, 推荐系统, 隐式反馈, 元数据

Abstract: It is extremely practical and challenging to implement personalized recommendation based on large-scale implicit feedback information.In order to solve the problem of data sparseness and then achieve effective recommendation combining various side information,this paper proposed an implicit feedback recommendation model combining node2vec and deep neural networks.This model utilizes a deep neural network framework with embedded meta-data(Meta-DNN),and maps the users and items vectors in a low-dimensional manner.Wherein,the second-order random walk of node2vec is used to learn neighbor nodes in the network with embedded meta-data so that adjacent nodes have similar node representations.Besides,data sparsity is alleviated via improving the smoothness among neighboring users and items.Finally,deep neural network is used for further learning user preferences for items,thus providing recommendation for users.In addition,the popularity parameter is introduced to perform non-average sampling of unknown items and an implicit feedback negative sampling strategy is optimized.Experimental results on the typical Gowalla and Mo-vieLens-1M data sets demonstrate the prediction performance and recommendation quality of the proposed model compared with state-of-the-art recommendation algorithms.

Key words: Deep learning, Implicit feedback, Meta-data, Neural networks, Node2vec, Recommender system

中图分类号:

TP391

何瑾琳, 刘学军, 徐新艳, 毛宇佳. 融合node2vec和深度神经网络的隐式反馈推荐模型[J]. 计算机科学, 2019, 46(6): 41-48. https://doi.org/10.11896/j.issn.1002-137X.2019.06.005

HE Jin-lin, LIU Xue-jun, XU Xin-yan, MAO Yu-jia. Implicit Feedback Recommendation Model Combining Node2vec and Deep Neural Networks[J]. Computer Science, 2019, 46(6): 41-48. https://doi.org/10.11896/j.issn.1002-137X.2019.06.005

参考文献

[1]LI X,CONG G,LI X L,et al.Rank-GeoFM:A Ranking based Geographical Factorization Method for Point of Interest Recommendation[C]∥International ACM SIGIR Conference on Research and Development in Information Retrieval.Santiago:ACM,2015:433-442.
[2]HE X,ZHANG H,KAN M Y,et al.Fast Matrix Factorization for Online Recommendation with Implicit Feedback[C]∥International ACM SIGER Conference on Research & Development in Information Retrieval.Pisa:ACM,2016:549-558.
[3]WANG H,WANG N,YEUNG D Y.Collaborative Deep Lear-ning for Recommender Systems[C]∥ACM SIGKDD Internatio-nal Conference on Knowledge Discovery and Data Mining.Sydney:ACM,2015:1235-1244.
[4]SHENG L,JAYA K,YUN F.Deep Collaborative Filtering via Marginalized Denoising Auto-encoder[C]∥ACM International on Conference on Information and Knowledge Management.Melbourne:ACM,2015:811-820.
[5]HE X,LIAO L,ZHANG H,et al.Neural Collaborative Filtering [C]∥International Conference on World Wide Web.Perth:ACM,2017:173-182.
[6]MIKOLOV T,SUTSKEVER I,CHEN K,et al.Distributed Representations of Words and Phrases and their Compositionality [J].Advances in Neural Information Processing Systems,2013,26:3111-3119.
[7]VASILE F,SMIRNOVA E,CONNEAU A.Meta-Prod2Vec: Product Embeddings Using Side-Information for Recommendation[C]∥ACM Conference on Recommender Systems.Boston:ACM,2016:225-232.
[8]HANDCOCK M S,RAFTERY A E,TANTRUM J M.Model-based clustering for social networks [J].Journal of the Royal Statistical Society,2007,170(2):301-354.
[9]TANG J,QU M,WANG M,et al.LINE:Large-scale Information Network Embedding[C]∥Proceedings of the 24th International Conference on World Wide Web.International World Wide Web Conferences Steering Committee,2015:1067-1077.
[10]PERPZZIE B,Al-RFOU R,SKIENA S.Deepwalk:online lear-ning of social representations[C]∥Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Disco-very and Data Mining.New York:ACM,2014:701-710.
[11]GROVER A,LESKOVEC J.node2vec:Scalable Feature Lear-ning for Networks [C]∥Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.San Francisco:ACM,2016:855-864.
[12]YANG Z,COHEN W W,SALAKHUTDINOV R.Revisiting semi-supervised learning with graph embeddings[C]∥International Conference on International Conference on Machine Learning.New York:ICML,2016:40-48.
[13]LU Y,CAO J.Research Status and Future Trends of Recom-mender Systems for Implicit Feedback [J].Computer Science,2016,43(4):7-15.(in Chinese)
陆艺,曹健.面向隐式反馈的推荐系统研究现状与趋势[J].计算机科学,2016,43(4):7-15.
[14]YAO W,HE J,HUANG G,et al.A graph-based model for context-aware recommendation using implicit feedback data [J].World Wide Web-internet & Web Information Systems,2015,18(5):1351-1371.
[15]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Ima-ge Recognition[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[16]ZHANG C,SHOU L,CHEN K,et al.Evaluating geo-social influence in location-based social networks[C]∥ACM International Conference on Information and Knowledge Management.Maui:ACM,2012:1442-1451.
[17]YIN J,WANG Z S,LI Q,et al.Personalized recommendation based on large-scale implicit feedback[J].Journal of Software,2014,5(9):1953-1966.(in Chinese)
印鉴,王智圣,李琪,等.基于大规模隐式反馈的个性化推荐[J].软件学报,2014,5(9):1953-1966 [18]RENDLE S,FREUDENTHALER C,GANTNER Z,et al.BPR:Bayesian personalized ranking from implicit feedback [C]∥Conference on Uncertainty in Artificial Intelligence.Montreal:AUAI Press,2009:452-461.
[19]HU Y,KOREN Y,VOLINSKY C.Collaborative Filtering for Implicit Feedback Datasets[C]∥IEEE International Conference on Data Mining.Leipzig:IEEE,2009:263-272.

相关文章 15

[1]	饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2]	宁晗阳, 马苗, 杨波, 刘士昌. 密码学智能化研究进展与分析 Research Progress and Analysis on Intelligent Cryptology 计算机科学, 2022, 49(9): 288-296. https://doi.org/10.11896/jsjkx.220300053
[3]	汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[4]	程章桃, 钟婷, 张晟铭, 周帆. 基于图学习的推荐系统研究综述 Survey of Recommender Systems Based on Graph Learning 计算机科学, 2022, 49(9): 1-13. https://doi.org/10.11896/jsjkx.210900072
[5]	王冠宇, 钟婷, 冯宇, 周帆. 基于矢量量化编码的协同过滤推荐方法 Collaborative Filtering Recommendation Method Based on Vector Quantization Coding 计算机科学, 2022, 49(9): 48-54. https://doi.org/10.11896/jsjkx.210700109
[6]	周芳泉, 成卫青. 基于全局增强图神经网络的序列推荐 Sequence Recommendation Based on Global Enhanced Graph Neural Network 计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[7]	周乐员, 张剑华, 袁甜甜, 陈胜勇. 多层注意力机制融合的序列到序列中国连续手语识别和翻译 Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion 计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[8]	徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[9]	李宗民, 张玉鹏, 刘玉杰, 李华. 基于可变形图卷积的点云表征学习 Deformable Graph Convolutional Networks Based Point Cloud Representation Learning 计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[10]	王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[11]	郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[12]	姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[13]	王润安, 邹兆年. 基于物理操作级模型的查询执行时间预测方法 Query Performance Prediction Based on Physical Operation-level Models 计算机科学, 2022, 49(8): 49-55. https://doi.org/10.11896/jsjkx.210700074
[14]	秦琪琦, 张月琴, 王润泽, 张泽华. 基于知识图谱的层次粒化推荐方法 Hierarchical Granulation Recommendation Method Based on Knowledge Graph 计算机科学, 2022, 49(8): 64-69. https://doi.org/10.11896/jsjkx.210600111
[15]	方义秋, 张震坤, 葛君伟. 基于自注意力机制和迁移学习的跨领域推荐算法 Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning 计算机科学, 2022, 49(8): 70-77. https://doi.org/10.11896/jsjkx.210600011

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed