Computer Science ›› 2019, Vol. 46 ›› Issue (7): 38-49.doi: 10.11896/j.issn.1002-137X.2019.07.006

• Surveys • Previous Articles     Next Articles

Review on Click-through Rate Prediction Models for Display Advertising

LIU Meng-juan1,ZENG Gui-chuan1,YUE Wei1,QIU Li-zhou1,WANG Jia-chang2   

  1. (School of Information and Software Engineering,University of Electronic Science and Technology of China,Chengdu 610054,China)1
    (Nuclear Power Institute of China,Chengdu 610213,China)2
  • Received:2018-07-05 Online:2019-07-15 Published:2019-07-15

Abstract: In recent years,the study of the click-through rate prediction model has attracted much attention from academia and industry.As for the existing CTR prediction models for displaying targeted advertising,this paper studied the preprocessing techniques for features of samples,the CTR prediction schemes based on traditional machine learning models and the latest deep learning models,and the main performance evaluation indexes of CTR prediction models.Specially,these typical CTR prediction schemes were evaluated based on a public dataset,further some quantitative analysis and performance comparison were given.Finally,the problems and research trends in CTR prediction were discussed.

Key words: Click-through rate prediction, Deep learning, Factorization machine, Logistic regression, Targeted advertising

CLC Number: 

  • TP311
[1]OLIVIER C.Offline evaluation of response prediction in online advertising auctions[C]∥The International Conference of World Wide Web.Florence,Italy,2015:18-22.<br /> [2]LIU P,WANG C.Computational advertising:market and technology of Internet business realization [M].Beijing:The People’s Posts and Telecommunications Press,2015.(in Chinese)<br /> 刘鹏,王超.计算广告:互联网商业变现的市场与技术[M].北京:人民邮电出版社,2015.<br /> [3]WANG J,ZHANG W,YUAN S.Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting [J].Foundations & Trends in Information Retrieval,2017,11(4-5):297-435.<br /> [4]李航.统计学习方法[M].北京:清华大学出版社,2012.<br /> [5]伊恩·古德费洛,约书亚·本吉奥,亚伦·库维尔.深度学习[M].赵申剑,黎彧君,符天凡,等译.北京:人民邮电出版社,2017.<br /> [6]BECK J E,WOOLF B P.High-level Student Modeling with Machine Learning[M]∥Intelligent Tutoring Systems.Berlin,Germany,2000:584-593.<br /> [7]ZHANG W,DU T,WANG J.Deep Learning over Multi-field Categorical Data:A Case Study on User Response Prediction[C]∥Proceedings of European Conference on Information Retrieval.Switzerland Cham:Springer,2016:45-57.<br /> [8]CHENG H T,KOC L,HARMSEN J,et al.Wide & Deep Learning for Recommender Systems[C]∥The Workshop on Deep Learning for Recommender Systems.Boston,USA,2016:7-10.<br /> [9]GUO H,TANG R,YE Y,et al.DeepFM:A Factorization-Machine based Neural Network for CTR Prediction[C]∥Procee-dings of the Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne,Australia,2017:1725-1731.<br /> [10]WANG R,FU B,FU G,et al.Deep & Cross Network for Ad Click Predictions[C]∥Proceedings of AdKDD and TargetAd.Halifax,2017:1-7 .<br /> [11]BOTTOU L.Online Learning and Neural Networks[M].Cambridge,UK:Cambridge University Press,1998.<br /> [12]ZINKEVICH M.Online Convex Programming and Generalized Infinitesimal Gradient Ascent:Technical Report CMU-CS-03-110[R].Carnegie Mellon University,2003.<br /> [13]DUCHI J,SINGER Y.Efficient Online and Batch Learning Using Forward Backward Splitting[J].Journal of Machine Learning Research,2009,10(18):2899-2934.<br /> [14]XIAO L.Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization[J].Journal of Machine Learning Research,2010,11(1):2543-2596.<br /> [15]MCMAHAN H B,HOLT G,SCULLEY D,et al.Ad click prediction:a view from the trenches[C]∥ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.Chicago,2013:1222-1230.<br /> [16]CHANG Y W,HSIEH C J,CHANG K W,et al.Training and Testing Low-degree Polynomial Data Mappings via Linear SVM[J].Journal of Machine Learning Research,2014,11(11):1471-1490.<br /> [17]OENTARYO R J,LIM E P,LOW J W,et al.Predicting response in mobile advertising with hierarchical importance-aware factorization machine[C]∥ACM International Conference on Web Search and Data Mining.New York,USA:ACM,2014:123-132.<br /> [18]RENDLE S.Factorization Machines with libFM[J].Acm Transactions on Intelligent Systems & Technology,2012,3(3):1-22.<br /> [19]JUAN Y,ZHUANG Y,CHIN W S,et al.Field-aware Factorization Machines for CTR Prediction[C]∥ACM Conference on Recommender Systems.Boston MA,USA:ACM,2016:43-50.<br /> [20]HE X R,PAN J F,JIN O,et al.Practical lessons from predicting clicks on ads at facebook [C]∥ACM SIGKDD Conference on Knowledge Discovery and Data Mining.New York,USA,2014:1-9.<br /> [21]ZHOU Z H.Ensemble Methods:Foundations and Algorithms [M].New York:CRC press,2012.<br /> [22]JUAN Y C,CHIN W S,ZHUANG Y.kaggle-2014-criteo[DB/OL].[2018-07-12].ttps://github.com/guestwalk/kaggle-2014-criteo.<br /> [23]KRIZHEVSKY A,SUTSKEVER I,HINTON G.ImageNet Classification with Deep Convolutional Neural Networks[J].Advances in neural information processing systems,2012,25(2):1097-1105.<br /> [24]ALEX G,ABDEL-RAHMAN M,GEOFFREY H.Speech re- cognition with deep recurrent neural networks [C]∥IEEE International Conference on Acoustics,Speech and Signal Proces-sing.Vancouver,Canada,2013:6645-6649.<br /> [25]SHEN Y L,HE X D,GAO J F,et al.A latent semantic model with convolutional-pooling structure for information retrieval [C]∥ACM International Conference on Conference on Information and Knowledge Management.Shanghai,China,2014:101-110.<br /> [26]周志华.机器学习[M].北京:清华大学出版社,2016:114.<br /> [27]QU Y R,CAI H,REN K,et al.Product-based neural networks for user response prediction[C]∥IEEE International Confe-rence on Data Mining.Barcelona,Spain,2016:1-6.<br /> [28]LIAO H R,PENG L X,LIU Z C,et al.Ipinyou global rtb bidding algorithm competition dataset[C]∥ACM SIGKDD Confe-rence on Knowledge Discovery and Data Mining.New York,USA,2014:1-6.<br /> [29]MURPHY K P.Machine Learning:A Probabilistic Perspective[M].Boston:MIT,2012.<br /> [30]HE H,GARCIA E A.Learning from imbalanced data[J].IEEE Transactions on Knowledge and Data Engineering,2009,21(9):1263-1284.<br /> [31]XIE Q Z,DAI Z H,DU Y L,et al.Controllable Invariance through Adversarial Feature Learning[C]∥31st Conference on Neural Information Processing Systems.Long Beach,CA,USA,2017.<br /> [32]DENG Y,SHEN Y,JIN H,et al.Disguise Adversarial Networks for Click-through Rate Prediction[C]∥Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne.Australia,2017:1589-1595.<br /> [33]SU Y H,JIN Z M,CHEN Y,et al.Improving Click-Through Rate Prediction Accuracy in Online Advertising by Transfer Learning [C]∥Proceedings of WI 17.Leipzig,Germany,2017.<br /> [34]ZHANG W,ZHOU T,WANG J,et al.Bid-aware Gradient Descent for Unbiased Learning with Censored Data in Display Advertising[C]∥ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.San Francisco,CA,USA,2016:665-674.<br /> [35]JASON Y,JEFF C,YOSHUA B,et al.How transferable are features in deep neural networks[C]∥Advances in Neural Information Processing Systems.Montreal,Canada,2014:3320-3328.<br /> [36]XIAO J,YE H,HE X N.Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks[C]∥Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne,Australia,2017:3119-3125.<br /> [37]HE X G,CHUA T S.Neural Factorization Machines for Sparse Predictive Analytics[C]∥The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.Shinjuku,Tokyo,Japan,2017:355-364.<br /> [38]CHEN J,SUN B,LI H,et al.Deep CTR Prediction in Display Advertising[C]∥The 2016 ACM Multimedia Conference.Amsterdam,Netherlands,2016:811-820.<br /> [39]CHAPELLE O,MANAVOGLU E,ROSALES R.Simple and Scalable Response Prediction for Display Advertising [J].ACM Transactions on Intelligent Systems and Technology,2014,5(4):1-34.<br /> [40]LEE K C,ORTEN B,DASDAN A,et al.Estimating Conver- sion Rate in Display Advertising From Past Performance Data [C]∥Proceedings of the 18<sup>th</sup> ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM press,2012:768-776.<br /> [41]GRAEPEL T,CANDELA Q,BORCHERT T,et al.Web-scale Bayesian Click-throuth Rate Prediction for Sponsored Search Advertising in Microsoft’s Bing Search Engine [C]∥Procee-dings of the 27<sup>th</sup> International Conference on Machine Learning.Israel:Omnipress,2010:13-20.<br /> [42]RICHARDSON M,DOMINOWSKA E,RAGNO R.Predicting Clicks:Estimating the Click-through Rate for New Ads[C]∥International Conference on World Wide Web.Canada:ACM,2007:521-530.
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] SHUAI Jian-bo, WANG Jin-ce, HUANG Fei-hu, PENG Jian. Click-Through Rate Prediction Model Based on Neural Architecture Search [J]. Computer Science, 2022, 49(7): 10-17.
[9] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[10] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[11] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[12] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[13] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[14] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[15] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!