Computer Science ›› 2019, Vol. 46 ›› Issue (8): 111-115.doi: 10.11896/j.issn.1002-137X.2019.08.018

• HPC China 2018 • Previous Articles     Next Articles

Deep Neural Network Recommendation Model Based on User Vectorization Representation and Attention Mechanism

GUO Xu1, ZHU Jing-hua1,2   

  1. (School of Computer Science and Technology,Heilongjiang University,Harbin 150080,China)1
    (Key Laboratory of Database and Parallel Computing of Heilongjiang Province,Harbin 150080,China)2
  • Received:2018-10-21 Online:2019-08-15 Published:2019-08-15

Abstract: With the rapid development of Internet application,recommendation system,as an effective measure to solve information overloading,has become a research hot topic in industry and academia.Traditional recommendation algorithms for users’ implicit feedback are mainly based on collaborative filtering and learning-to-rank method,which do not make full use of the implicit feedback features in users’ behaviors.In this paper,a users’ vectorization representation model based on neural network was proposed,which can make full use of heterogeneous implicit feedback features of users’ behaviors.At the same time,referring to the self-attention mechanism in machine translation,this paper designed a neural attentive recommendation model which integrates the dynamic temporal features of user-item interaction and user vectorization representation,to improve the performance of the recommendation system.The comparison experiment is conducted on two public datasets,and the recommendation performance is evaluated by recall,precision and NDCG.Compared with other recommendation models for implicit feedback,the proposed recommendation model has better recommendation performance and better generalization ability

Key words: Attention mechanism, Deep learning, Implicit feedback, Neural networks, Recommendation system

CLC Number: 

  • TP391
[1]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[M]∥Advances in Neural Information Processing Systems.Bertin:Springer,2017:5998-6008.
[2]SARWAR B,KARYPIS G,KONSTAN J,et al.Item-based collaborative filtering recommendation algorithms[C]∥Procee-dings of the 10th International Conference on World Wide Web.ACM,2001:285-295.
[3]OSTUNI V C,DI NOIA T,DI SCIASCIO E,et al.Top-n recommendations from implicit feedback leveraging linked open data[C]∥Proceedings of the 7th ACM Conference on Recommender Systems.ACM,2013:85-92.
[4]ZIMDARS A,CHICKERING D M,MEEK C.Using temporal data for making recommendations[C]∥Proceedings of the Se-venteenth Conference on Uncertainty in artificial intelligence.Morgan Kaufmann Publishers Inc.,2001:580-588.
[5]RENDLE S,FREUDENTHALER C,GANTNER Z,et al.BPR:Bayesian personalized ranking from implicit feedback[C]∥Proceedings of the Twenty-fifth Conference on Uncertainty in Artificial Intelligence.AUAI Press,2009:452-461.
[6]SEDHAIN S,MENON A K,SANNER S,et al.Autorec:Autoencoders meet collaborative filtering[C]∥Proceedings of the 24th International Conference on World Wide Web.ACM,2015:111-112.
[7]ELKAHKY A M,SONG Y,HE X.A multi-view deep learning approach for cross domain user modeling in recommendation systems[C]∥Proceedings of the 24th International Conference on World Wide Web.International World Wide Web Confe-rences Steering Committee,2015:278-288.
[8]HE X,LIAO L,ZHANG H,et al.Neural collaborative filtering[C]∥Proceedings of the 26th International Conference on World Wide Web.International World Wide Web Conferences Steering Committee,2017:173-182.
[9]HIDASI B,KARATZOGLOU A,BALTRUNAS L,et al.Session-based recommendations with recurrent neural networks[J].arXiv:1511.06939,2015.
[10]GONG Y,ZHANG Q.Hashtag Recommendation Using Attention-Based Convolutional Neural Network[C]∥Proceedings of International Joint Conference on Artificial Intelligence.AAAI Press,2016:2782-2788.
[11]LI Y,LIU T,JIANG J,et al.Hashtag recommendation with topical attention-based LSTM[C]∥Proceedings of the 26th International Conference on Computational Linguistics.ACL,2016:3019-3029.
[12]XIAO J,YE H,HE X,et al.Attentional factorization machines:Learning the weight of feature interactions via attention networks[J].arXiv:1708.04617,2017.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[5] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[6] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[7] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[8] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[9] QIN Qi-qi, ZHANG Yue-qin, WANG Run-ze, ZHANG Ze-hua. Hierarchical Granulation Recommendation Method Based on Knowledge Graph [J]. Computer Science, 2022, 49(8): 64-69.
[10] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[11] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[12] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[13] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[14] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[15] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!