Computer Science ›› 2024, Vol. 51 ›› Issue (8): 313-323.doi: 10.11896/jsjkx.230500143

• Artificial Intelligence • Previous Articles     Next Articles

Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism

CHEN Shanshan, YAO Subin   

  1. School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing 210003,China
  • Received:2023-05-22 Revised:2024-03-04 Online:2024-08-15 Published:2024-08-13
  • About author:CHEN Shanshan,born in 1980,Ph.D,associate professor.Her main research interests include large-scale distributed storage systems and architectures and so on.
       

Abstract: In order to solve the cold start problem caused by traditional recommendation algorithms when they face the recommendation task with sparse data,this paper introduces the knowledge graph into the recommendation algorithm,combing a new neighbor perception attention mechanism to replace the traditional graph attention mechanism to mine the higher-order connected information between entities,and proposes a recommendation model KGNPAN based on the knowledge graph and neighbor perce-ption attention mechanism.Thanks to the knowledge graph,recommendations can be accurate,diverse and interpretable.This model can effectively alleviate issues of data sparsity and cold start.Firstly,this model utilizes the graph embedding method RotatE based on self adversarial negative sampling to expand the semantic information of the original item and user representations,mapping entity and relationship vectors into low dimensional embedding vectors.Secondly,based on the different types of collaborative neighbors,neighbor perception attention mechanisms are applied to aggregate neighbor node information,enrich the semantics of target nodes,and recursively mine high-order connected information in convolutional form.Finally,the inner product operation is applied to calculate the interaction probability between the user and the project vector,and the recommendation result is obtained.Experiments are conducted on two common benchmark datasets,Amazon-book and Last-FM,and compared with six benchmark models,namely CKE,BPRMF,RippleNet,KGAT,KGCN,and CAKN,KGNPAN.The results show that KGNPAN improves the recall rate by 1.30% and 1.37%,and normalized discounted cumulative gain(NDCG) increases by 1.26% and 1.14%,respectively,compared with CAKN model,which has the best performance in the benchmark modes,verifying the effectiveness and interpretability of the model.

Key words: Recommended algorithm, Neighbor perception attention mechanism, Knowledge graph, Graph neural network, Cold start

CLC Number: 

  • TP181
[1]CHENG Y H,LIU N,LU Y,et al.Recurrent knowledge attention network for movie recommendation[C]//2020 3rd International Conference on Electron Device and Mechanical Enginee-ring(ICEDME).IEEE,2020:648-651.
[2]MA W,ZHANG M,CAO Y,et al.Jointly learning explainable rules for recommendation with knowledge graph[C]//The World Wide Web Conference.2019:1210-1221.
[3]LIU D Y,LIAN J X,WANG S Y,et al.KRED:Knowledge-aware document representation for news recommendations[C]//Proceedings of the 14th ACM Conference on Recommender Systems.2020:200-209.
[4]HANSEN C,HANSEN C,MAYSTRE L,et al.Contextual and sequential user embeddings for large-scale music recommendation[C]//Proceedings of the 14th ACM Conference on Recommender Systems.2020:53-62.
[5]SHU J B,SHEN X X,LIU H,et al.A content-based recommendation algorithm for learning resources[J].Multimedia Systems,2018,24(2):163-173.
[6]NILASHI M,OTHMAN BIN I,NORAFIDA I.Multi-criteriacollaborative filtering with high accuracy using higherorder singular value decomposition and Neuro-Fuzzysystem[J].Know-ledge-Based Systems,2014,60:82-101.
[7]ZHANG J D,CHOW C Y,XU J.Enabling kernel-based attri-bute-aware matrix factorization for rating prediction[J].IEEE Transactions on Knowledge and Data Engineering,2016,29(4):798-812.
[8]LU Q B,GUO F P.Personalized information recommendationmodel based on context contribution and item correlation[J].Measurement,2019,142:30-39.
[9]YE J M,SONG J Q,ZHANG K,et al.Research on ExerciseRecommendation Algorithm for Online Judge System Enhanced by Knowledge Graph[J].Journal of Chinese Computer Systems,2023,44(11):2558-2565.
[10]ZHAGN X X,TANG Y Q,ZHAO W,et al.Personalized Lear-ning Resource Recommendation Based on Knowledge Graph and Graph Embedding[J].Computer Systems & Applications,2023,32(5):180-187.
[11]LUO C T,YE X.Survey on Knowledge Graph-Based Recom-mendation Methods[J].Computer Engineering and Applications,2023,59(1):49-60.
[12]WANG H,ZHANG F,XIE X,et al.DKN:Deep knowledge-aware network for news recommendation[C]//Proceedings of the 2018 World Wide Web Conference.2018:1835-1844.
[13]WANG X,HE X,CAO Y,et al.Kgat:Knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Disco-very & Data Mining.2019:950-958.
[14]VELICKOVIC P,CUCURULL G,CASANOVA A,et al.Graphattention networks[J].arXiv:1710.10903,2017.
[15]ZHAO H,YAO Q,LI J, et al.Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks[J].SIGKDD Explorations,2017(CD/ROM):584-593.
[16]XIAN Y,FU Z,MUTHUKRISHNAN S,et al.Reinforcementknowledge graph reasoning for explainable recommendation[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.2019:285-294.
[17]HAMILTON W,YING Z,LESKOVEC J.Inductive representation learning on large graphs[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.2017:1025-1035.
[18]ZHANG F,YUAN N J,LIAN D,et al.Collaborative know-ledge base embedding for recommender systems[C]//Procee-dings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:353-362.
[19]JI G,HE S,XU L,et al.Knowledge graph embedding via dy-namic mapping matrix[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing(volume 1:Long papers).2015:687-696.
[20]WANG H,ZHANG F,WANG J,et al.Ripplenet:Propagatinguser preferences on the knowledge graph for recommender systems[C]//Proceedings of the 27th ACM International Confe-rence on Information and Knowledge Management.2018:417-426.
[21]LIN X,QUAN Z,WANG Z J,et al.KGNN:Knowledge Graph Neural Network for Drug-Drug Interaction Prediction[C]//IJCAI.2020:2739-2745.
[22]WANG H,ZHAO M,XIE X,et al.Knowledge graph convolutional networks for recommender systems[C]//The World Wide Web Conference.2019:3307-3313.
[23]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Proceedings of the 26th International Conference on Neural Information Processing Systems-Volume 2.2787-2795.
[24]WANG Z,ZHANG J,FENG J,et al.Knowledgegraph embed-ding by translating on hyperplanes[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2014,28(1).
[25]LIN Y,LIU Z,SUN M,et al.Learning entity and relation embeddings for knowledge graph completion[C]//Twenty-ninth AAAI Conference on Artificial Intelligence.2015.
[26]SUN Z,DENG Z H,NIE J Y,et al.Rotate:Knowledge graph embedding by relational rotation in complex space[J].arXiv:1902.10197,2019.
[27]NICKEL M,TRESP V,KRIEGEL H P.A three-way model for collective learning on multi-relational data[C]//ICML.2011.
[28]YANG B,YIH S W,HE X,et al.Embedding Entities and Relations for Learning and Inference in Knowledge Bases[C]//Proceedings of the International Conference on Learning Representations(ICLR).2015.
[29]HAMILTON W,YING Z T,LESKOVEC J.Inductiverepresen-tation learning on large graphs[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.2017:1025-1035.
[30]ZHANG F Z,YUAN N J,LIAN D F,et al.Collaborative know-ledge base embedding for recommender systems[C]//Procee-dings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016.
[31]RENDLE S,FREUENTHALER C,GANTNER Z,et al.BPR:Bayesian personalized ranking from implicit feedback[C]//Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence.2012:452-461.
[32]WANG H,ZHAO M,XIE X,et al.Knowledge graph convolutional networks for recommender systems[C]//The World Wide Web Conference.2019:3307-3313.
[33]WANG Z,LIN G,TAN H,et al.CKAN:collaborative know-ledge-aware attentive network for recommender systems[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval.2020:219-228.
[1] HU Haibo, YANG Dan, NIE Tiezheng, KOU Yue. Graph Contrastive Learning Incorporating Multi-influence and Preference for Social Recommendation [J]. Computer Science, 2024, 51(7): 146-155.
[2] WEI Ziang, PENG Jian, HUANG Feihu, JU Shenggen. Text Classification Method Based on Multi Graph Convolution and Hierarchical Pooling [J]. Computer Science, 2024, 51(7): 303-309.
[3] ZHANG Hui, ZHANG Xiaoxiong, DING Kun, LIU Shanshan. Device Fault Inference and Prediction Method Based on Dynamic Graph Representation [J]. Computer Science, 2024, 51(7): 310-318.
[4] HE Jing, ZHAO Rui, ZHANG Hengshuo. Visual Bibliometric Analysis of Knowledge Graph [J]. Computer Science, 2024, 51(6A): 230500123-10.
[5] TANG Xin, SUN Yufei, WANG Yujue, SHI Min, ZHU Dengming. Three Layer Knowledge Graph Architecture for Industrial Digital Twins [J]. Computer Science, 2024, 51(6A): 230400153-6.
[6] LIU Wei, SONG You, ZHUO Peiyan, WU Weiqiang, LIAN Xin. Study on Kcore-GCN Anti-fraud Algorithm Fusing Multi-source Graph Features [J]. Computer Science, 2024, 51(6A): 230600040-7.
[7] ZHU Yuliang, LIU Juntao, RAO Ziyun, ZHANG Yi, CAO Wanhua. Knowledge Reasoning Model Combining HousE with Attention Mechanism [J]. Computer Science, 2024, 51(6A): 230600209-8.
[8] PENG Bo, LI Yaodong, GONG Xianfu, LI Hao. Method for Entity Relation Extraction Based on Heterogeneous Graph Neural Networks and TextSemantic Enhancement [J]. Computer Science, 2024, 51(6A): 230700071-5.
[9] DONG Wanqing, ZHAO Zirong, LIAO Huimin, XIAO Hui, ZHANG Xiaoliang. Research and Implementation of Urban Traffic Accident Risk Prediction in Dynamic Road Network [J]. Computer Science, 2024, 51(6A): 230500118-10.
[10] CHEN Sishuo, WANG Xiaodong, LIU Xiyang. Survey of Breast Cancer Pathological Image Analysis Methods Based on Graph Neural Networks [J]. Computer Science, 2024, 51(6): 172-185.
[11] CHU Xiaoxi, ZHANG Jianhui, ZHANG Desheng, SU Hui. Browser Fingerprint Tracking Based on Improved GraphSAGE Algorithm [J]. Computer Science, 2024, 51(6): 409-415.
[12] LU Min, YUAN Ziting. Graph Contrast Learning Based Multi-graph Neural Network for Session-based RecommendationMethod [J]. Computer Science, 2024, 51(5): 54-61.
[13] LAN Yongqi, HE Xingxing, LI Yingfang, LI Tianrui. New Graph Reduction Representation and Graph Neural Network Model for Premise Selection [J]. Computer Science, 2024, 51(5): 193-199.
[14] ZHANG Liying, SUN Haihang, SUN Yufa , SHI Bingbo. Review of Node Classification Methods Based on Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(4): 95-105.
[15] ZHANG Tao, LIAO Bin, YU Jiong, LI Ming, SUN Ruina. Benchmarking and Analysis for Graph Neural Network Node Classification Task [J]. Computer Science, 2024, 51(4): 132-150.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!