Computer Science ›› 2023, Vol. 50 ›› Issue (7): 66-71.doi: 10.11896/jsjkx.220900125

• Database & Big Data & Data Science • Previous Articles     Next Articles

Variational Continuous Bayesian Meta-learning Based Algorithm for Recommendation

ZHU Wentao1,3, LIU Wei1,3, LIANG Shangsong1,3, ZHU Huaijie2,3, YIN Jian2,3   

  1. 1 School of Computer Science and Engineering,Sun Yat-sen University,Guangzhou 511436,China
    2 School of Artificial Intelligence,Sun Yat-sen University,Zhuhai,Guangdong 519082,China
    3 Guangdong Key Laboratory of Big Data Analysis and Processing,Guangzhou 510006,China
  • Received:2022-09-24 Revised:2023-02-07 Online:2023-07-15 Published:2023-07-05
  • About author:ZHU Wentao,born in 2000,postgra-duate.Her main research interests include recommendation system and meta-learning.LIU Wei,born in 1989,Ph.D,associate researcher,is a member of China Computer Federation.His main research interests include recommendation system and spatio-temporal data mining.
  • Supported by:
    National Natural Science Foundation of China(U1911203,61902439,61902438,62002396) and Guangdong Basic and Applied Basic Research Foundation(2021A1515011902,2020A1515011251,2019A1515011159,2019A1515011704).

Abstract: Meta-learning methods have been introduced into recommendation algorithms in recent years to alleviate the problem of cold start.The existing meta-learning algorithms can only improve the ability of the algorithm to deal with a set of statically distributed data sets(tasks).When faced with multiple data sets subject to non-stationary distribution,the existing models often have negative knowledge transfer and catastrophic forgetting problems,resulting in a significant decline in algorithm recommendation performance.This paper explores a recommendation algorithm based on variational continuous Bayesian Meta-learning(VC-BML).Firstly,the algorithm assumes that the meta parameters follow the dynamic mixed Gaussian model,which makes it have a larger parameter space,improves the ability of the model to adapt to different tasks,and alleviates the problem of negative knowledge transfer.Then,the number of task clusters in VC-BML is flexibly determined by Chinese restaurant process(CRP),which enables the model to store knowledge of different task distributions in different mixed components and invoke this know-ledge when similar tasks occur,helping to alleviate the catastrophic forgetting problem in traditional algorithms.To estimate the posterior probabilities of model parameters,a more robust structured variational reasoning method is used to approximate the posterior values to avoid forgetting knowledge.Finally,VC-BML outperforms the baselines on all four datasets with non-stationary distributions.Compared with point-based estimation methods,VC-BML improves the robustness of the model and helps alle-viate the catastrophic forgetting problem.

Key words: Recommendation algorithm, Cold-start problem, Meta-learning, Dynamic Gaussian mixture model

CLC Number: 

  • TP391
[1]MCNEE S M,RIEDL J,KONSTAN J A.Being accurate is not enough:how accuracy metrics have hurt recommender systems[C]//Extended Abstracts(CHI’06).2006:1097-1101.
[2]LI X,SHE J.Collaborative variational autoencoder for recommender systems[C]//KDD.2017:305-314.
[3]OORD A V D,DIELEMAN S,SCHRAUWEN B.Deep content-based music recommendation[C]//NIPS.2013:2643-2651.
[4]WEI J,HE J H,CHEN K,et al.Collaborative filtering and deeplearning based recommendation system for cold start items[J].Expert Systems with Applications,2017,69:29-39.
[5]LEE H,IM J,JANG S,et al.Melu:Meta-learned user preferenceestimator for cold-start recommendation[C]//KDD.2019:1073-1082.
[6]DENEVI G,STAMOS D,CILIBERTO C,et al.Online-within-online meta-learning[C]//NIPS.2019:1-11.
[7]VILALTA R,DRISSI Y.A perspective view and survey ofmeta-learning[J].Artificial Intelligence Review,2002,18(2):77-95.
[8]FINN C,ABBEEL P,LEVINE S.Model-agnostic meta-learning for fast adaptation of deep networks[C]//ICML.2017:1126-1135.
[9]LIANG S S,YILMAZ E,KANOULAS E.Collaboratively tra-cking interests for user clustering in streams of short texts[J].IEEE Transactions on Knowledge Data Engineering,2018,31(2):257-272.
[10]ZHANG Q,FANG J Y,MENG Z Q,et al.Varisational Conti-nual Bayesian Meta-Learning[C]//NIPS.2021:24556-24568.
[11]CHENG H T,KOC L,HARMSEN J,et al.Wide deep learning for recommender systems[C]//DLRS.2016:7-10.
[12]HE X N,LIAO L Z,ZHANG H W,et al.Neural collaborative filtering[C]//WWW.2017:173-182.
[13]BARKAN O,KOENIGSTEIN N.Item2vec:Neural item embedding for collaborative filtering[C]//IEEE MLSP.2016:1-6.
[14]ZHANG F Z,YUAN N J,LIAN D F,et al.Collaborative know-ledge base embedding for recommender systems[C]//KDD.2016:353-362.
[15]NAIR V,EHINTON G.Rectified linear units improve restricted boltzmann machines vinodnair[C]//ICML-10.2010:807-814.
[16]FINN C,RAJESWARAN A,KAKADE S,et al.Online meta-learning[EB/OL].(2019-02-22) [2019-07-03].https://doi.org/10.48550/arXiv.1902.08438.
[17]KALAI A,VEMPALA S.Efficient algorithms for online decision problems[J].Journal of Computer and System Sciences,2005,71(3):291-307.
[18]JERFEL G,GRANT E,GRIFFITHS T,et al.Reconciling meta-learning and continual learning with online mixtures of tasks[EB/OL].(2018-12-14) [2019-06-19].https://doi.org/10.48550/arXiv.1812.06080.
[19]YAP P,RITTER H,BARBER D.Bayesian online meta-lear-ning with Online Laplace Approximation[J].arXiv:2005.00146,2020.
[1] SHANG Di, LYU Yanfeng, QIAO Hong. Incremental Object Detection Inspired by Memory Mechanisms in Brain [J]. Computer Science, 2023, 50(2): 267-274.
[2] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[3] PU Qian-qian, LEI Hang, LI Zhen-hao, LI Xiao-yu. Personalized News Recommendation Algorithm with Enhanced List Information and User Interests [J]. Computer Science, 2022, 49(6): 142-148.
[4] WANG Mei-ling, LIU Xiao-nan, YIN Mei-juan, QIAO Meng, JING Li-na. Deep Learning Recommendation Algorithm Based on Reviews and Item Descriptions [J]. Computer Science, 2022, 49(3): 99-104.
[5] ZHOU Ying, CHANG Ming-xin, YE Hong, ZHANG Yan. Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer [J]. Computer Science, 2022, 49(3): 185-191.
[6] DONG Jia-wei, SUN Fu-zhen, WU Xiang-shuai, WU Tian-hui, WANG Shao-qing. Variational Recommendation Algorithm Based on Differential Hamming Distance [J]. Computer Science, 2022, 49(12): 178-184.
[7] DONG Yun-xin, LIN Geng, ZHANG Qing-wei, CHEN Ying-ting. Recommendation Algorithm Based on Apriori Algorithm and Improved Similarity [J]. Computer Science, 2022, 49(11A): 211000005-5.
[8] DONG Xiao-mei, WANG Rui, ZOU Xin-kai. Survey on Privacy Protection Solutions for Recommended Applications [J]. Computer Science, 2021, 48(9): 21-35.
[9] WU Shao-bo, FU Qi-ming, CHEN Jian-ping, WU Hong-jie, LU You. Meta-inverse Reinforcement Learning Method Based on Relative Entropy [J]. Computer Science, 2021, 48(9): 257-263.
[10] ZHAO Jin-long, ZHAO Zhong-ying. Recommendation Algorithm Based on Heterogeneous Information Network Embedding and Attention Neural Network [J]. Computer Science, 2021, 48(8): 72-79.
[11] XIONG Xu-dong, DU Sheng-dong, XIA Wan-jun, LI Tian-rui. Recommendation Algorithm Based on Bipartite Graph Convolution Representation [J]. Computer Science, 2021, 48(4): 78-84.
[12] CHEN Yuan-yi, FENG Wen-long, HUANG Meng-xing, FENG Si-ling. Collaborative Filtering Recommendation Algorithm of Behavior Route Based on Knowledge Graph [J]. Computer Science, 2021, 48(11): 176-183.
[13] NING Ze-fei, SUN Jing-yu, WANG Xin-juan. Recommendation Algorithm Based on Knowledge Graph and Tag-aware [J]. Computer Science, 2021, 48(11): 192-198.
[14] WANG Rui-ping, JIA Zhen, LIU Chang, CHEN Ze-wei, LI Tian-rui. Deep Interest Factorization Machine Network Based on DeepFM [J]. Computer Science, 2021, 48(1): 226-232.
[15] LIU Jun-liang, LI Xiao-guang. Techniques for Recommendation System:A Survey [J]. Computer Science, 2020, 47(7): 47-55.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!