计算机科学 ›› 2019, Vol. 46 ›› Issue (9): 216-222.doi: 10.11896/j.issn.1002-137X.2019.09.032

• 人工智能 • 上一篇    下一篇

LDA模型和列表排序混合的协同过滤推荐算法

王涵, 夏鸿斌   

  1. (江南大学数字媒体学院 江苏 无锡214122);
    (江南大学江苏省媒体设计与软件技术重点实验室 江苏 无锡214122)
  • 收稿日期:2018-07-12 出版日期:2019-09-15 发布日期:2019-09-02
  • 通讯作者: 夏鸿斌(1973-),男,博士,副教授,主要研究方向为计算机网络优化、社交媒体与数据挖掘、智能Web系统,E-mail:hbxia@163.com
  • 作者简介:王 涵(1993-),女,硕士生,CCF会员,主要研究方向为推荐系统、机器学习,E-mail:W_hwang@163.com;
  • 基金资助:
    国家科学支撑计划课题(2015BAH54F01)

Collaborative Filtering Recommendation Algorithm Mixing LDA Model and List-wise Model

WANG Han, XIA Hong-bin   

  1. (School of Digital Media,Jiangnan University,Wuxi,Jiangsu 214122,China);
    (Key Laboratory of Media Design and Software Technology of Jiangsu Province,Jiangnan University,Wuxi,Jiangsu 214122,China)
  • Received:2018-07-12 Online:2019-09-15 Published:2019-09-02

摘要: 基于排序学习的协同过滤推荐算法受数据稀疏性的影响,出现了推荐不准确性的问题。为此,文中提出了一种结合LDA主题模型和列表排序的混合排序学习协同过滤算法。该算法首先使用LDA主题模型对用户-项目评分矩阵建模,获取用户潜在低维主题向量来度量用户之间的相似度;然后通过列表排序学习函数为用户直接预测满足其偏好的排序列表。在Movielens和EachMovie两个真实数据集上的实验结果表明:该算法可以避免排序学习算法由于用户间共同评分信息过少引起的相似度计算不准确的问题,同时体现出了排序推荐的优越性,有效缓解了数据稀疏性带来的影响,提高了推荐准确度。

关键词: LDA主题模型, 列表排序, 排序学习, 协同过滤

Abstract: Rranking-oriented collaborative filtering is affected by the sparsity of data,which leads to the inaccuracy of recommendations.This paper proposed a hybrid ranking-oriented collaborative filtering algorithm based on LDA topic model and list-wise model.The algorithm uses the LDA topic model to model the user-item ratings matrix,and obtains the potential low-dimensional topic vector of the user,then measures the similarity between users with the topic vector.Next,the list-wise learning function is used to directly predict the total order of items that satisfies the users preference.The experimental results on the two real datasets of Movielens and EachMovie show that the algorithm can avoid the inaccuracy of similarity calculation between users caused by too little common score information,and at the same time reflect the superiority of learning to rank.It can effectively alleviate the effect of data sparsity and improve the accuracy of recommendation.

Key words: Collaborative filtering, LDA topic model, Learning to rank, List-wise model

中图分类号: 

  • TP301
[1]SCHAFER J B,DAN F,HERLOCKER J,et al.Collaborative Filtering Recommender Systems[J].Acm Transactions on Information Systems,2007,22(1):5-53.
[2]XING Y Y,XIA H B,WANG H.An Improved ALS Algorithm for Online Recommendation with Missing Data Modeling[J].Computer Engineering,2018,44(8):218-223.
[3]HUANG S,WANG S,LIU T Y,et al.Listwise collaborative filtering[C]//Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval.ACM,2015:343-352.
[4]LINDEN G,SMITH B,YORK J.Amazon.com Recommendations:Item-to-Item Collaborative Filtering[J].IEEE Internet Computing,2003,7(1):76-80.
[5]HOFMANN T.Latent semantic models for collaborative filtering[J].ACM Transactions on Information Systems,2004,22(1):89-115.
[6]HUANG Z H,ZHANG J W,TIAN C Q,et al.Survey on Learning-to-Rank Based Recommendation Algorithms [J].Journal of Software,2016,27(3):691-713.(in Chinese)黄震华,张佳雯,田春岐,等.基于排序学习的推荐算法研究综述[J].软件学报,2016,27(3):691-713.
[7]FANG C,ZHANG H,ZHANG M,et al.RecommendationsBased on Listwise Learning-to-Rank by Incorporating Social Information[J].Ksii Transactions on Internet & Information Systems,2018,12(1):109-134.
[8]LU Y,CAO J.Research Status and Future Trends of Recommender Systems for Implicit Feedback [J].Computer Science,2016,43(4):7-15.(in Chinese)陆艺,曹健.面向隐式反馈的推荐系统研究现状与趋势[J].计算机科学,2016,43(4):7-15.
[9]BLEI D M,NG A Y,JORDAN M I.Latent dirichlet allocation[J].J Machine Learning Research Archive,2003,3(1):993-1022.
[10]LIAN T,MA J,WANG S Q,et al.LDA-CF:A Mixture Model for Collaborative Filtering [J].Journal of Chinese Information Processing,2014,28(2):129-135.(in Chinese)廉涛,马军,王帅强,等.LDA-CF:一种混合协同过滤方法[J].中文信息学报,2014,28(2):129-135.
[11]SHI Y,LARSON M,HANJALIC A.List-wise learning to rank with matrix factorization for collaborative filtering[C]//ACM Conference on Recommender Systems,Recsys 2010.Barcelona,Spain,DBLP,2010:269-272.
[12]LIU J,WU C,XIONG Y,et al.List-wise probabilistic matrix factorization for recommendation[J].Information Sciences,2014,278(9):434-447.
[13]BREESE J S,HECKERMAN D,KADIE C.Empirical analysisof predictive algorithms for collaborative filtering[C]//Procee-dings of the Fourteenth Annual Confe-rence on Uncertainty in Artificial Intelligence.Morgan Kaufmann Publishers Inc.,1998:43-52.
[14]LIU N N,YANG Q.EigenRank:a ranking-oriented approach to collaborative filtering[C]//International ACM SIGIR Conference on Research and Development in Information Retrieval.ACM,2008:83-90.
[15]WANG S,SUN J,GAO B J,et al.VSRank:A Novel Framework for Ranking-Based Collaborative Filtering[J].Acm Transactions on Intelligent Systems & Technology,2014,5(3):1-24.
[16]KULLBACK S.Information Theory and Statistics[J].Population,1962,17(17):377-378.
[17]XIONG H X,DOU Y.Research on Tag Hybrid Recommendation Based on LDA Topic Model[J].Library and Information Service,2018,62(3):104-113.
[18]GAO N,YANG M.Topic Model Embedded in Collaborative Filtering Recommendation Algorithm[J].Computer Science,2016,43(3):57-61.(in Chinese)高娜,杨明.嵌入LDA主题模型的协同过滤推荐算法[J].计算机科学,2016,43(3):57-61.
[19]ZHOU X,WU S.Rating LDA model for collaborative filtering[J].Knowledge-Based Systems,2016,110:135-143.
[20]PENG M,XI J J,DAI X Y,et al.Collaborative Filtering Recommendation Based on Sentiment Analysis and LDA Topic Model[J].Journal of Chinese Information Processing,2017,31(2):194-203.(in Chinese)彭敏,席俊杰,代心媛,等.基于情感分析和LDA主题模型的协同过滤推荐算法[J].中文信息学报,2017,31(2):194-203.
[21]CAO Z,QIN T,LIU T Y,et al.Learning to rank:from pairwise approach to listwise approach[C]//International Conference on Machine Learning.ACM,2007:129-136.
[1] 程章桃, 钟婷, 张晟铭, 周帆.
基于图学习的推荐系统研究综述
Survey of Recommender Systems Based on Graph Learning
计算机科学, 2022, 49(9): 1-13. https://doi.org/10.11896/jsjkx.210900072
[2] 王冠宇, 钟婷, 冯宇, 周帆.
基于矢量量化编码的协同过滤推荐方法
Collaborative Filtering Recommendation Method Based on Vector Quantization Coding
计算机科学, 2022, 49(9): 48-54. https://doi.org/10.11896/jsjkx.210700109
[3] 孙晓寒, 张莉.
基于评分区域子空间的协同过滤推荐算法
Collaborative Filtering Recommendation Algorithm Based on Rating Region Subspace
计算机科学, 2022, 49(7): 50-56. https://doi.org/10.11896/jsjkx.210600062
[4] 蔡晓娟, 谭文安.
一种改进的融合相似度和信任度的协同过滤算法
Improved Collaborative Filtering Algorithm Combining Similarity and Trust
计算机科学, 2022, 49(6A): 238-241. https://doi.org/10.11896/jsjkx.210400088
[5] 何亦琛, 毛宜军, 谢贤芬, 古万荣.
基于点割集图分割的矩阵变换与分解的推荐算法
Matrix Transformation and Factorization Based on Graph Partitioning by Vertex Separator for Recommendation
计算机科学, 2022, 49(6A): 272-279. https://doi.org/10.11896/jsjkx.210600159
[6] 郭亮, 杨兴耀, 于炯, 韩晨, 黄仲浩.
基于注意力机制和门控网络相结合的混合推荐系统
Hybrid Recommender System Based on Attention Mechanisms and Gating Network
计算机科学, 2022, 49(6): 158-164. https://doi.org/10.11896/jsjkx.210500013
[7] 蒲岍岍, 雷航, 李贞昊, 李晓瑜.
增强列表信息和用户兴趣的个性化新闻推荐算法
Personalized News Recommendation Algorithm with Enhanced List Information and User Interests
计算机科学, 2022, 49(6): 142-148. https://doi.org/10.11896/jsjkx.210400173
[8] 董晓梅, 王蕊, 邹欣开.
面向推荐应用的差分隐私方案综述
Survey on Privacy Protection Solutions for Recommended Applications
计算机科学, 2021, 48(9): 21-35. https://doi.org/10.11896/jsjkx.201100083
[9] 詹皖江, 洪植林, 方路平, 吴哲夫, 吕跃华.
基于对抗性学习的协同过滤推荐算法
Collaborative Filtering Recommendation Algorithm Based on Adversarial Learning
计算机科学, 2021, 48(7): 172-177. https://doi.org/10.11896/jsjkx.200600077
[10] 邵超, 宋淑米.
基于信任关系下用户兴趣偏好的协同过滤推荐算法
Collaborative Filtering Recommendation Algorithm Based on User Preference Under Trust Relationship
计算机科学, 2021, 48(6A): 240-245. https://doi.org/10.11896/jsjkx.200700113
[11] 武建新, 张志鸿.
融合用户评分与显隐兴趣相似度的协同过滤推荐算法
Collaborative Filtering Recommendation Algorithm Based on User Rating and Similarity of Explicit and Implicit Interest
计算机科学, 2021, 48(5): 147-154. https://doi.org/10.11896/jsjkx.200300072
[12] 肖诗涛, 邵蓥侠, 宋卫平, 崔斌.
面向协同过滤推荐的新型混合评分函数
Hybrid Score Function for Collaborative Filtering Recommendation
计算机科学, 2021, 48(3): 113-118. https://doi.org/10.11896/jsjkx.200900067
[13] 郝志峰, 廖祥财, 温雯, 蔡瑞初.
基于多上下文信息的协同过滤推荐算法
Collaborative Filtering Recommendation Algorithm Based on Multi-context Information
计算机科学, 2021, 48(3): 168-173. https://doi.org/10.11896/jsjkx.200700101
[14] 韩立锋, 陈莉.
融合用户属性与项目流行度的用户冷启动推荐模型
User Cold Start Recommendation Model Integrating User Attributes and Item Popularity
计算机科学, 2021, 48(2): 114-120. https://doi.org/10.11896/jsjkx.200900152
[15] 张健雄, 宋坤, 何鹏, 李兵.
基于图神经网络的软件系统中关键类的识别
Identification of Key Classes in Software Systems Based on Graph Neural Networks
计算机科学, 2021, 48(12): 149-158. https://doi.org/10.11896/jsjkx.210100200
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!