Computer Science ›› 2019, Vol. 46 ›› Issue (9): 216-222.doi: 10.11896/j.issn.1002-137X.2019.09.032

• Artificial Intelligence • Previous Articles     Next Articles

Collaborative Filtering Recommendation Algorithm Mixing LDA Model and List-wise Model

WANG Han, XIA Hong-bin   

  1. (School of Digital Media,Jiangnan University,Wuxi,Jiangsu 214122,China);
    (Key Laboratory of Media Design and Software Technology of Jiangsu Province,Jiangnan University,Wuxi,Jiangsu 214122,China)
  • Received:2018-07-12 Online:2019-09-15 Published:2019-09-02

Abstract: Rranking-oriented collaborative filtering is affected by the sparsity of data,which leads to the inaccuracy of recommendations.This paper proposed a hybrid ranking-oriented collaborative filtering algorithm based on LDA topic model and list-wise model.The algorithm uses the LDA topic model to model the user-item ratings matrix,and obtains the potential low-dimensional topic vector of the user,then measures the similarity between users with the topic vector.Next,the list-wise learning function is used to directly predict the total order of items that satisfies the users preference.The experimental results on the two real datasets of Movielens and EachMovie show that the algorithm can avoid the inaccuracy of similarity calculation between users caused by too little common score information,and at the same time reflect the superiority of learning to rank.It can effectively alleviate the effect of data sparsity and improve the accuracy of recommendation.

Key words: Collaborative filtering, Learning to rank, List-wise model, LDA topic model

CLC Number: 

  • TP301
[1]SCHAFER J B,DAN F,HERLOCKER J,et al.Collaborative Filtering Recommender Systems[J].Acm Transactions on Information Systems,2007,22(1):5-53.
[2]XING Y Y,XIA H B,WANG H.An Improved ALS Algorithm for Online Recommendation with Missing Data Modeling[J].Computer Engineering,2018,44(8):218-223.
[3]HUANG S,WANG S,LIU T Y,et al.Listwise collaborative filtering[C]//Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval.ACM,2015:343-352.
[4]LINDEN G,SMITH B,YORK Recommendations:Item-to-Item Collaborative Filtering[J].IEEE Internet Computing,2003,7(1):76-80.
[5]HOFMANN T.Latent semantic models for collaborative filtering[J].ACM Transactions on Information Systems,2004,22(1):89-115.
[6]HUANG Z H,ZHANG J W,TIAN C Q,et al.Survey on Learning-to-Rank Based Recommendation Algorithms [J].Journal of Software,2016,27(3):691-713.(in Chinese)黄震华,张佳雯,田春岐,等.基于排序学习的推荐算法研究综述[J].软件学报,2016,27(3):691-713.
[7]FANG C,ZHANG H,ZHANG M,et al.RecommendationsBased on Listwise Learning-to-Rank by Incorporating Social Information[J].Ksii Transactions on Internet & Information Systems,2018,12(1):109-134.
[8]LU Y,CAO J.Research Status and Future Trends of Recommender Systems for Implicit Feedback [J].Computer Science,2016,43(4):7-15.(in Chinese)陆艺,曹健.面向隐式反馈的推荐系统研究现状与趋势[J].计算机科学,2016,43(4):7-15.
[9]BLEI D M,NG A Y,JORDAN M I.Latent dirichlet allocation[J].J Machine Learning Research Archive,2003,3(1):993-1022.
[10]LIAN T,MA J,WANG S Q,et al.LDA-CF:A Mixture Model for Collaborative Filtering [J].Journal of Chinese Information Processing,2014,28(2):129-135.(in Chinese)廉涛,马军,王帅强,等.LDA-CF:一种混合协同过滤方法[J].中文信息学报,2014,28(2):129-135.
[11]SHI Y,LARSON M,HANJALIC A.List-wise learning to rank with matrix factorization for collaborative filtering[C]//ACM Conference on Recommender Systems,Recsys 2010.Barcelona,Spain,DBLP,2010:269-272.
[12]LIU J,WU C,XIONG Y,et al.List-wise probabilistic matrix factorization for recommendation[J].Information Sciences,2014,278(9):434-447.
[13]BREESE J S,HECKERMAN D,KADIE C.Empirical analysisof predictive algorithms for collaborative filtering[C]//Procee-dings of the Fourteenth Annual Confe-rence on Uncertainty in Artificial Intelligence.Morgan Kaufmann Publishers Inc.,1998:43-52.
[14]LIU N N,YANG Q.EigenRank:a ranking-oriented approach to collaborative filtering[C]//International ACM SIGIR Conference on Research and Development in Information Retrieval.ACM,2008:83-90.
[15]WANG S,SUN J,GAO B J,et al.VSRank:A Novel Framework for Ranking-Based Collaborative Filtering[J].Acm Transactions on Intelligent Systems & Technology,2014,5(3):1-24.
[16]KULLBACK S.Information Theory and Statistics[J].Population,1962,17(17):377-378.
[17]XIONG H X,DOU Y.Research on Tag Hybrid Recommendation Based on LDA Topic Model[J].Library and Information Service,2018,62(3):104-113.
[18]GAO N,YANG M.Topic Model Embedded in Collaborative Filtering Recommendation Algorithm[J].Computer Science,2016,43(3):57-61.(in Chinese)高娜,杨明.嵌入LDA主题模型的协同过滤推荐算法[J].计算机科学,2016,43(3):57-61.
[19]ZHOU X,WU S.Rating LDA model for collaborative filtering[J].Knowledge-Based Systems,2016,110:135-143.
[20]PENG M,XI J J,DAI X Y,et al.Collaborative Filtering Recommendation Based on Sentiment Analysis and LDA Topic Model[J].Journal of Chinese Information Processing,2017,31(2):194-203.(in Chinese)彭敏,席俊杰,代心媛,等.基于情感分析和LDA主题模型的协同过滤推荐算法[J].中文信息学报,2017,31(2):194-203.
[21]CAO Z,QIN T,LIU T Y,et al.Learning to rank:from pairwise approach to listwise approach[C]//International Conference on Machine Learning.ACM,2007:129-136.
[1] MA Li-bo, QIN Xiao-lin. Topic-Location-Category Aware Point-of-interest Recommendation [J]. Computer Science, 2020, 47(9): 81-87.
[2] LUO Jia-lei and MENG Li-min. Signal Timing Scheme Recommendation Algorithm Based on Intersection Similarity [J]. Computer Science, 2020, 47(6A): 66-69.
[3] ZHU Lei, HU Qin-han, ZHAO Lei, YANG Ji-wen. Collaborative Filtering Algorithm Based on Rating Preference and Item Attributes [J]. Computer Science, 2020, 47(4): 67-73.
[4] ZHAO Nan, PI Wen-chao, XU Chang-qiao. Video Recommendation Algorithm for Multidimensional Feature Analysis and Filtering [J]. Computer Science, 2020, 47(4): 103-107.
[5] FENG Chen-jiao,LIANG Ji-ye,SONG Peng,WANG Zhi-qiang. New Similarity Measure Based on Extremely Rating Behavior [J]. Computer Science, 2020, 47(2): 31-36.
[6] WU Lei,YUE Feng,WANG Han-ru,WANG Gang. Academic Paper Recommendation Method Combined with Researcher Tag [J]. Computer Science, 2020, 47(2): 51-57.
[7] YU Dun-hui, CHENG Tao, YUAN Xu. Software Crowdsourcing Task Recommendation Algorithm Based on Learning to Rank [J]. Computer Science, 2020, 47(12): 106-113.
[8] HUANG Chao-ran, GAN Yong-shi. Balance Between Preference and Universality Based on Explicit Feedback Collaborative Filtering [J]. Computer Science, 2020, 47(11A): 471-473.
[9] YANG Yang, DI Yi-de, LIU Jun-hui, YI Chao, ZHOU Wei. Study on Learning to Rank Based on Tensor Decomposition in Personalized Tag Recommendation [J]. Computer Science, 2020, 47(11A): 515-519.
[10] KANG Yan, BU Rong-jing, LI Hao, YANG Bing, ZHANG Ya-chuan, CHEN Tie. Neural Collaborative Filtering Based on Enhanced-attention Mechanism [J]. Computer Science, 2020, 47(10): 114-120.
[11] DENG Cun-bin, YU Hui-qun, FAN Gui-sheng. Integrating Dynamic Collaborative Filtering and Deep Learning for Recommendation [J]. Computer Science, 2019, 46(8): 28-34.
[12] ZHANG Yan-hong, ZHANG Chun-guang, ZHOU Xiang-zhen, WANG Yi-ou. Diverse Video Recommender Algorithm Based on Multi-property Fuzzy Aggregate of Items [J]. Computer Science, 2019, 46(8): 78-83.
[13] KANG Lin-yao, TANG Bing, XIA Yan-min, ZHANG Li. GPU-accelerated Non-negative Matrix Factorization-based Parallel Collaborative Filtering Recommendation Algorithm [J]. Computer Science, 2019, 46(8): 106-110.
[14] ZHANG Lei,CAI Ming. Image Annotation Based on Topic Fusion and Frequent Patterns Mining [J]. Computer Science, 2019, 46(7): 246-251.
[15] WANG Xu, PANG Wei, WANG Zhe. MetaStruct-CF:A Meta Structure Based Collaborative Filtering Algorithm in Heterogeneous Information Networks [J]. Computer Science, 2019, 46(6A): 397-401.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .