一种面向多维特征分析过滤的视频推荐算法

doi:10.11896/jsjkx.190700177

摘要/Abstract

摘要： 近年来,抖音、快手、微视等短视频APP取得了巨大成功,用户拍摄并上传到APP平台上的视频数量暴增。在这种信息过载的环境下,为用户挖掘并推荐其感兴趣的视频成为了视频发布平台面临的难题,因此为这些平台设计高效的视频推荐算法显得尤其重要。文中针对媒体大数据挖掘和推荐领域的数据集稀疏性高和规模巨大的问题,提出一种面向多维特征分析过滤的视频推荐算法。首先,从用户行为和视频标签等多个维度对视频进行特征提取,然后进行相似性分析,加权计算视频相似度,从而获取相似视频候选集,并对相似视频候选集进行过滤,再通过排序选择评分最高的若干个视频推荐给用户。最后,基于MovieLens公开数据集,使用python3语言实现了文中提出的视频推荐算法。在数据集上进行的大量实验表明,相比传统的协同过滤算法,文中提出的面向多维特征分析过滤的视频推荐算法将推荐结果的准确率提升了6%,召回率提升了4%,覆盖率提升了18%。实验数据充分说明,从多个维度考虑视频之间的相似性,并配合大规模矩阵分解技术,在一定程度上缓解了数据集稀疏性高、数据量巨大的难题,从而有效地提高了推荐结果的准确性、召回率和覆盖率。

关键词: 视频推荐, 特征提取, 相似性分析, 协同过滤, 稀疏性

Abstract: In recent years,short video apps such as TikTok,Kwai,and WeiShi have achieved great success,and the number of videos taken by users and uploaded to the APP platform has skyrocketed.In this environment of information overload,mining and recommending videos of interest to users has become a problem faced by video publishing platforms.Therefore,it is particularly important to design efficient video recommendation algorithms for these platforms.Aiming at the problem of high sparseness and huge scale of datasets in the field of media big data mining and recommendation,a video recommendation algorithm for multidimensional feature analysis and filtering is proposed.First,feature extraction is performed on videos from multiple dimensions such as user behavior and video tags.Then,similarity analysis is performed to calculate the video similarity by weighting to obtain similar video candidate sets,the similar video candidate sets are filtered,and then several videos selected by ranking the highest rated videos are recommended to users.Finally,based on the MovieLens public data set,the video recommendation algorithm proposed in this paper is implemented by using python3 programming language.A large number of experiments on the data set show that compared with the traditional collaborative filtering algorithm,the video recommendation algorithm for multidimensional feature analysis and filtering proposed in the paper improves the accuracy of the recommendation results by 6%,the recall rate by 4%,and the coverage rate by 18%.The experimental data fully demonstrates that considering the similarity between videos from multiple dimensions,combined with large-scale matrix factorization technology,the problems of high sparseness and huge data volume of the data set are alleviated to some extent,thereby effectively improving the recommendation results accuracy,recall,and coverage.

Key words: Video recommendation, Feature extraction, Similarity analysis, Collaborative filtering, Sparsity

中图分类号:

TP399

赵楠, 皮文超, 许长桥. 一种面向多维特征分析过滤的视频推荐算法[J]. 计算机科学, 2020, 47(4): 103-107.

ZHAO Nan, PI Wen-chao, XU Chang-qiao. Video Recommendation Algorithm for Multidimensional Feature Analysis and Filtering[J]. Computer Science, 2020, 47(4): 103-107.

参考文献

[1]ZHENG L S,YANG S Q,HE J,et al.An optimized collaborative filtering recommendation algorithm[C]//2016 2nd International Conference on Cloud Computing and Internet of Things (CCIOT).Dalian,IEEE,2016:89-92.
[2]ZHAN M F,LI L,HUANG Q M,et al.Cross-media retrieval with semantics clustering and enhancement[C]//2017 IEEE International Conference on Multimedia and Expo (ICME).Hong Kong,China,IEEE,2017:1398-1403.
[3]BRADLEY K,SMYTH B.Improving recommendation diversity [C]// Proceedings of the Twelfth Irish Conference on Artificial Intelligence and Cognitive Science.Irish:AICS,2001:85-94.
[4]SU L Y,CHEN X B.Improvement of user-based collaborative filtering algorithms[J].Computer Engineering & Software,2017(4):135-140.
[5]HU Y,PENG Q,HU X,et al.Time Aware and Data Sparsity Tolerant Web Service Recommendation Based on Improved Collaborative Filtering[J].IEEE Transactions on Services Computing,2015,8(5):782-794.
[6]WANG X M,ZHANG X M,WU Y T,et al.Collaborative filtering recommendation algorithm based on heuristic clustering model and category similarity [J].Journal of Electronic Science,2016,44 (7):1708-1713.
[7]KUMAR Y,SHARMA A,KHAUND A,et al.IceBreaker:Solving Cold Start Problem for Video Recommendation Engines[C]//2018 IEEE International Symposium on Multimedia (ISM).IEEE,2018:217-222.
[8]PATRA B K,LAUNONEN R,OLLIKAINEN V,et al.Exploiting bhattacharyya similarity measure to diminish user cold-start problem in sparse data[M]//Discovery Science.Cham:Springer,2014:252-263.
[9]HUANG C G,YIN J,WANG J,et al.Uncertain neighbors collaborative filtering recommendation algorithm[J].Chinese Journal of Computers,2010,33(8):1369-1377.
[10]HE Y,YANG S,JIAO C,et al.A Hybrid Collaborative Filtering Recommendation Algorithm for Solving the Data Sparsity[C]// 2011 International Symposium on Computer Science and Society.2011:118-121.
[11]WANG P,YE H W.A Personalized Recommendation Algorithm Combining Slope One Scheme and User Based Collaborative Filtering [C]// 2009 International Conference on Industrial and Information Systems.2009:152-154.
[12]CACHEDA F,FORMOSO V.Comparison of collaborative filtering algorithms:Limitations of current techniques and proposals for scalable,high -performance recommender systems [J].ACM Transactions on the Web,2011,5(1):1-33.
[13]DESHPANDE M,KARYPIS G.Item-based top-N recommendation algorithms[J].ACM Transactionon Information Systems,2004,22(1):143-177.
[14]WANG P,QIAN Q,SHANG Z,et al.An recommendation algorithm based on weighted Slope one algorithm and user-based collaborative filtering [C]// 2016 Chinese Control and Decision Conference (CCDC).2016:2431-2434.
[15]ZARZOUR H,AL-SHARIF Z,AL-AYYOUB M,et al.A new collaborative filtering recommendation algorithm based on dimensionality reduction and clustering techniques [C]// 2018 9th International Conference on Information and Communication Systems (ICICS).2018:102-106.
[16]ARORA S,GOEL S.Improving the Accuracy of Recommender Systems Through Annealing[J].Lecture Notes in Networks and Systems,2017,1(1):295-304.
[17]KOREN Y,BELL R,VOLINSKY C.Matrix Factorization Techniques for Recommender Systems[J].Computer,2009,42(8):30-37.
[18]SHEUGH L,ALIZADEH S H.A note on pearson correlation coefficient as a metric of similarity in recommender system [C]// 2015 AI & Robotics (IRANOPEN).2015:1-6.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed