Computer Science ›› 2022, Vol. 49 ›› Issue (8): 70-77.doi: 10.11896/jsjkx.210600011

• Database & Big Data & Data Science • Previous Articles     Next Articles

Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning

FANG Yi-qiu1, ZHANG Zhen-kun1, GE Jun-wei2   

  1. 1 School of Computer Science and Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    2 School of Software Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2021-06-01 Revised:2021-09-03 Published:2022-08-02
  • About author:FANG Yi-qiu,born in 1963,master,associate professor,graduate supervisor.Her main research interests include cloud computing and big data.
    ZHANG Zhen-kun,born in 1997,master.His main research interests include big data and so on.
  • Supported by:
    National Natural Science Foundation of China(62072066).

Abstract: Traditional single-domain recommendation algorithm is limited by the sparse relationship between users and items,and there is a problem of user/item cold start,and only models the item ratings by users,ignoring the information contained in the review text.The cross-domain recommendation algorithm based on review text extracts user/item review information in the auxiliary domain to alleviate data sparseness in the target domain and improve the accuracy of recommendation.This paper proposes a cross-domain recommendation algorithm SAMTL that combines self-attention mechanism and transfer learning.Different from existing algorithms,SAMTL fully integrates the knowledge of the target domain and auxiliary domains.Firstly,the self-attention mechanism is introduced to model user’s preference information.Then,by the cross-mapping cross-domain transmission network,the recommendation accuracy of another domain is improved with the help of information in one domain.Finally,the information of the two domains is integrated in the knowledge fusion and scoring prediction module to perform scoring prediction.Experiments on Amazon data set show that,compared with the existing cross-domain recommendation model,SAMTL has higher MAE and MSE values,and MAE increases by 8.4%,13.2% and 19.4% on three different cross-domain data sets,MSE increases by 6.3%,7.8% and 5.6% respectively.A number of experiments verify the effectiveness of self-attention mechanism and transfer learning,as well as the advantages in alleviating data sparsity and user cold start problems.

Key words: Comment text, Cross-domain, Recommendation system, Self-attention, Transfer learning

CLC Number: 

  • TP391
[1]MOONEY R J,ROY L.Content-Based Book RecommendingUsing Learning for Text Categorization[J].arXiv:cs/9902011,1999.
[2]BALABANOVIC M,SHOHAM Y.Fab:content-based,collaborative recommendation[J].Communications of the ACM,1997,40(3):66-72.
[3]SALAKHUTDINOV R,MNIH A,HINTON G.Restricted Boltzmann machines for collaborative filtering[C]//Proceedings of the 24th International Conference on Machine Learning.2007:791-798.
[4]ZHU F,WANG Y,CHEN C,et al.A deep framework for cross-domain and cross-system recommendations[C]//IJCAI International Joint Conference on Artificial Intelligence.2018:3711-3717.
[5]KHAN M M,IBRAHIM R,GHANI I.Cross domain recommender systems:a systematic literature review[J].ACM Computing Surveys(CSUR),2017,50(3):1-34.
[6]PAN W,XIANG E,LIU N,et al.Transfer learning in collaborative filtering for sparsity reduction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2010:230-235.
[7]MAN T,SHEN H,JIN X,et al.Cross-Domain Recommendation:An Embedding and Mapping Approach[C]//IJCAI.2017:2464-2470.
[8]WANG X,PENG Z,WANG S,et al.Cross-domain Recommendation for Cold-start Users via Neighborhood based feature mapping[C]//International Conference on Database Systems for Advanced Applications.Cham:Springer,2018:158-165.
[9]FU W,PENG Z,WANG S,et al.Deeply Fusing Reviews andContents for Cold Start Users in Cross-Domain Recommendation Systems[J].Proceedings of the AAAI Conference on Artificial Intelligence,2019,33:94-101.
[10]LI C,QUAN C,PENG L,et al.A capsule network for recommendation and explaining what you like and dislike[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.2019:275-284.
[11]LONI B,SHI Y,LARSON M,et al.Cross-domain collaborative filtering with factorization machines[C]//European Conference on Information Retrieval.Cham:Springer,2014:656-661.
[12]LI B,QIANG Y,XUE X.Can movies and books collaborate?cross-domain collaborative filtering for sparsity reduction[C]//Twenty-First International Joint Conference on Artificial Intelligence.2009:2052-2057.
[13]LI B,YANG Q,XUE X.Transfer learning for collaborative filtering via a rating-matrix generative model[C]//Proceedings of the 26th Annual International Conference on Machine Learning.2009:617-624.
[14]PAN W,XIANG E,YANG Q.Transfer learning in collaborative filtering with uncertain ratings[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2012:662-668.
[15]KARATZOGLOU A,AMATRIAIN X,BALTRUNAS L,et al.Multiverse recommendation:N-dimensional tensor factorization for context-aware collaborative filtering[C]//Proceedings of the Fourth ACM Conference on Recommender Systems.2010:79-86.
[16]WANG J,LI S J,YANG S,et al.A new transfer learning model for cross-domain recommendation[J].Chinese Journal of Computers,2017,40(33):1-15.
[17]SHI Y,LARSON M,HANJALIC A.Tags as bridges between domains:Improving recommendation with tag-induced cross-domain collaborative filtering[C]//International Conference on User Modeling,Adaptation,and Personalization.Berlin:Sprin-ger,2011:305-316.
[18]SINGH A P,GORDON G J.Relational learning via collectivematrix factorization[C]//Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2008:650-658.
[19]ELKAHKY A M,SONG Y,HE X.A multi-view deep learning approach for cross domain user modeling in recommendation systems[C]//Proceedings of the 24th International Conference on World Wide Web.2015:278-288.
[20]HU L,CAO J,XU G,et al.Personalized recommendation viacross-domain triadic factorization[C]//Proceedings of the 22nd International Conference on World Wide Web.2013:595-606.
[21]WU J,XU J,DING T.Fine-grained image classification algo-rithm based on ensemble methods of transfer learning [J].Journal of Chongqing University of Posts and Telecommunications(Natural Science Edition),2020,32(3):452-458.
[22]PENNINGTON J,SOCHER R,MANNING C D.Glove:Global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing(EMNLP).2014:1532-1543.
[23]HU G,ZHANG Y,YANG Q.Conet:Collaborative cross networks for cross-domain recommendation[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management.2018:667-676.
[24]NAIR V,HINTON G E.Rectified linear units improve restric-ted boltzmann machines[C]//ICML.2010:807-814.
[25]SEO S,HUANG J,YANG H,et al.Interpretable convolutional neural networks with dual local and global attention for review rating prediction[C]//Proceedings of the eleventh ACM Confe-rence on Recommender Systems.2017:297-305.
[26]CHIN J Y,ZHAN K,JOTY S,et al.ANR:Aspect-based neural recommender[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management.2018:147-156.
[1] WU Zi-yi, LI Shao-mei, JIANG Meng-han, ZHANG Jian-peng. Ontology Alignment Method Based on Self-attention [J]. Computer Science, 2022, 49(9): 215-220.
[2] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[3] QIN Qi-qi, ZHANG Yue-qin, WANG Run-ze, ZHANG Ze-hua. Hierarchical Granulation Recommendation Method Based on Knowledge Graph [J]. Computer Science, 2022, 49(8): 64-69.
[4] CHEN Kun-feng, PAN Zhi-song, WANG Jia-bao, SHI Lei, ZHANG Jin. Moderate Clothes-Changing Person Re-identification Based on Bionics of Binocular Summation [J]. Computer Science, 2022, 49(8): 165-171.
[5] SHUAI Jian-bo, WANG Jin-ce, HUANG Fei-hu, PENG Jian. Click-Through Rate Prediction Model Based on Neural Architecture Search [J]. Computer Science, 2022, 49(7): 10-17.
[6] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[7] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[8] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[9] CAI Xiao-juan, TAN Wen-an. Improved Collaborative Filtering Algorithm Combining Similarity and Trust [J]. Computer Science, 2022, 49(6A): 238-241.
[10] HE Yi-chen, MAO Yi-jun, XIE Xian-fen, GU Wan-rong. Matrix Transformation and Factorization Based on Graph Partitioning by Vertex Separator for Recommendation [J]. Computer Science, 2022, 49(6A): 272-279.
[11] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[12] CHEN Yan-bing, ZHONG Chao-ran, ZHOU Chao-ran, XUE Ling-yan, HUANG Hai-ping. Design of Cross-domain Authentication Scheme Based on Medical Consortium Chain [J]. Computer Science, 2022, 49(6A): 537-543.
[13] HONG Zhi-li, LAI Jun, CAO Lei, CHEN Xi-liang, XU Zhi-xiong. Study on Intelligent Recommendation Method of Dueling Network Reinforcement Learning Based on Regret Exploration [J]. Computer Science, 2022, 49(6): 149-157.
[14] XIONG Zhong-min, SHU Gui-wen, GUO Huai-yu. Graph Neural Network Recommendation Model Integrating User Preferences [J]. Computer Science, 2022, 49(6): 165-171.
[15] ZHAO Dan-dan, HUANG De-gen, MENG Jia-na, DONG Yu, ZHANG Pan. Chinese Entity Relations Classification Based on BERT-GRU-ATT [J]. Computer Science, 2022, 49(6): 319-325.
Full text



No Suggested Reading articles found!