Computer Science ›› 2025, Vol. 52 ›› Issue (11A): 241200062-6.doi: 10.11896/jsjkx.241200062

• Big Data & Data Science • Previous Articles     Next Articles

Guided Diffusion Sequence Recommendation Methods

LI Bo, MO Xian   

  1. College of Information Engineering,Ningxia University,Yinchuan 750021,China
  • Online:2025-11-15 Published:2025-11-10
  • Supported by:
    National Natural Science Foundation of China(62306157) and Natural Science Foundation of Ningxia(2024AAC05011).

Abstract: With the dynamic change of user behavior preference,traditional sequential recommendation methods face the challenge of difficult to capture the change of user intention.In order to solve this problem,this study proposes guided diffusion sequence recommendation method(GDRec),which aims to achieve accurate capture of the user’s current intention by embedding the target item representation into the diffusion model.Specifically,the GDRec model includes the following key components:a sequence encoder,a cross-attention conditional denoising decoder,and a cross-divergence objective.The sequence encoder gradually generates the user preference representation to capture the dynamic relationship between the historical sequence and the current target.The cross-attention conditional denoising decoder removes the noise in the embedded representation and improves the prediction accuracy of the next target item.The cross-divergence objective,on the other hand,empowers the model with ranking capabilities,ensuring high quality representations,and embedding target item representations to guide the diffusion process.Finally,a large number of experiments on Amazon Office and Tools datasets prove that GDRec is superior to the existing advanced methods in multiple evaluation indicators,showing its superior performance in sequence recommendation tasks.In addition,ablation experiments and hyperparameter analysis further verify the effectiveness and stability of the model.

Key words: Sequential recommendation, Guided diffusion, Information embedding, User intent

CLC Number: 

  • TP393.1
[1]LIU Z,FAN Z,WANG Y,et al.Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer [C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.2021.
[2]WANG Y,LIU Z,ZHANG J,et al.DRDT:Dynamic reflectionwith divergent thinking for llm-based sequential recommendation [J].arXiv:2312.1136,2023.
[3]WANG Y,ZHANG H,LIU Z,et al.Contrastvae:Contrastive variational autoencoder for sequential recommendation[C]//Proceedings of the 31st ACM International Conference on Information & Knowledge Management.2022.
[4]XIE Z,LIU C,ZHANG Y,et al.Adversarial and contrastivevariational autoencoder for sequential recommendation[C]//Proceedings of the Web Conference 2021.2021.
[5]KANG W C,MCAULEY J.Self-attentive sequential recommendation[C]//Proceedings of the 2018 IEEE International Confe-rence on Data Mining(ICDM).IEEE,2018.
[6]SUN F,LIU J,WU J,et al.BERT4Rec:Sequential recommendation with bidirectional encoder representations from transformer [C]//Proceedings of the 28th ACM International Conference on Information and Knowledge Management.2019.
[7]JOZEFOWICZ R,ZAREMBA W,SUTSKEVER I.An empirical exploration of recurrent network architectures [C]//Procee-dings of the International Conference on Machine Learning.PMLR,2015.
[8]ZHOU Y,HUANG C,HU Q,et al.Personalized learning full-path recommendation model based on LSTM neural networks [J].Information Sciences,2018,444:135-152.
[9]HUANG X,QIAN S,FANG Q,et al.Csan:Contextual self-attention network for user sequential recommendation[C]//Proceedings of the 26th ACM International Conference on Multimedia.2018.
[10]CAO Y,ZHANG W,SONG B,et al.Position-aware context attention for session-based recommendation [J].Neurocmputing,2020,376:65-72.
[11]QIU R,HUANG Z,YIN H,et al.Contrastive learning for representation degeneration problem in sequential recommendation[C]//Proceedings of the Fifteenth ACM International Confe-rence on Web Search and Data Mining.2022.
[12]XIE X,SUN F,LIU Z,et al.Contrastive learning for sequential recommendation[C]//Proceedings of the 2022 IEEE 38th International Conference on Data Engineering(ICDE).IEEE,2022.
[13]GUO X,WANG Y,DU T,et al.Contranorm:A contrastivelearning perspective on oversmoothing and beyond [J].arXiv:2302.06562,2023.
[14]ZHOU K,WANG H,ZHAO W X,et al.S3-rec:Self-supervised learning for sequential recommendation with mutual information maximization[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management.2020.
[15]WANG Y,LIU Z,YANG L,et al.Conditional denoising diffusion for sequential recommendation[C]//Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mi-ning.Springer,2024.
[16]RENDLE S,FREUDENTHALER C,SCHMIDT-THIEME L.Factorizing personalized markov chains for next-basket recommendation[C]//Proceedings of the 19th International Confe-rence on World Wide Web.2010.
[17]SHANI G,HECKERMAN D,BRAFMAN R I,et al.An MDP-based recommender system [J].The Journal of Machine Lear-ning Research,2005,6(9):1265-1295.
[18]ZIMDARS A,CHICKERING D M,MEEK C J A P A.Using temporal data for making recommendations [C]//Proceedings of the 17th Conference on Uncertainty in Artificial Intelligence.2013:580-588.
[19]TANG J,WANG K.Personalized top-n sequential recommendation via convolutional sequence embedding[C]//Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining.2018.
[20]DING Y,MA Y,WONG W K,et al.Leveraging two types of global graph for sequential fashion recommendation[C]//Proceedings of the 2021 International Conference on Multimedia Retrieval.2021.
[21]HO J,JAIN A,ABBEEL P J A I N I P S.Denoising diffusion probabilistic models [J].arXiv:2006.11239,2020.
[22]GONG S,LI M,FENG J,et al.Diffuseq:Sequence to sequence text generation with diffusion models [J].arXiv:2210.08933,2022.
[23]DU H,YUAN H,HUANG Z,et al.Sequential recommendation with diffusion models [J].arXiv:2304.04541,2023.
[24]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C∥/Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[25]OORD A V D,LI Y,VINYALS O J A P A.Representation learning with contrastive predictive coding [J].arXiv:1807.03748,2018.
[26]MCAULEY J,TARGETT C,SHI Q,et al.Image-based recommendations on styles and substitutes[C]//Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval.2015.
[27]SACHDEVA N,MANCO G,RITACCO E,et al.Sequential va-riational autoencoders for collaborative filtering[C]//Procee-dings of the Twelfth ACM International Conference on Web Search and Data Mining.2019.
[28]HIDASI B,KARATZOGLOU A.Recurrent neural networkswith top-k gains for session-based recommendations[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management.2018.
[1] LIU Bing, XU Pengyu, LU Sijin, WANG Shijing, SUN Hongjian, JING Liping, YU Jian. Sequential Tag Recommendation [J]. Computer Science, 2025, 52(1): 142-150.
[2] WANG Zihong, SHAO Yingxia, HE Jiyuan, LIU Jinbao. Sequential Recommendation Based on Multi-space Attribute Information Fusion [J]. Computer Science, 2024, 51(3): 102-108.
[3] CHEN Yuzhe, CAO Qiong, HUANG Xianying, ZOU Shihao. MB-ATMK:Multi-behavior Sequential Recommendation Integrating Attribute Weights andTemporal Meta-knowledge [J]. Computer Science, 2024, 51(11A): 231100047-9.
[4] ZHENG Lin, LIN Yixuan, ZHOU Donglin, ZHU Fuxi. Explainable Constraint Mechanism for Modeling Temporal Sentiment Memory in Sequential Recommendation [J]. Computer Science, 2023, 50(6A): 220100066-8.
[5] CHEN Jin-peng, HU Ha-lei, ZHANG Fan, CAO Yuan, SUN Peng-fei. Convolutional Sequential Recommendation with Temporal Feature and User Preference [J]. Computer Science, 2022, 49(1): 115-120.
[6] YU Yue-zhang, XIA Tian-yu, JING Yi-nan, HE Zhen-ying, WANG Xiao-yang. Smart Interactive Guide System for Big Data Analytics [J]. Computer Science, 2021, 48(9): 110-117.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!