Computer Science ›› 2019, Vol. 46 ›› Issue (7): 38-49.doi: 10.11896/j.issn.1002-137X.2019.07.006

• Surveys • Previous Articles     Next Articles

Review on Click-through Rate Prediction Models for Display Advertising

LIU Meng-juan1,ZENG Gui-chuan1,YUE Wei1,QIU Li-zhou1,WANG Jia-chang2   

  1. (School of Information and Software Engineering,University of Electronic Science and Technology of China,Chengdu 610054,China)1
    (Nuclear Power Institute of China,Chengdu 610213,China)2
  • Received:2018-07-05 Online:2019-07-15 Published:2019-07-15

Abstract: In recent years,the study of the click-through rate prediction model has attracted much attention from academia and industry.As for the existing CTR prediction models for displaying targeted advertising,this paper studied the preprocessing techniques for features of samples,the CTR prediction schemes based on traditional machine learning models and the latest deep learning models,and the main performance evaluation indexes of CTR prediction models.Specially,these typical CTR prediction schemes were evaluated based on a public dataset,further some quantitative analysis and performance comparison were given.Finally,the problems and research trends in CTR prediction were discussed.

Key words: Click-through rate prediction, Targeted advertising, Logistic regression, Factorization machine, Deep learning

CLC Number: 

  • TP311
[1] OLIVIER C.Offline evaluation of response prediction in online advertising auctions[C]∥The International Conference of World Wide Web.Florence,Italy,2015:18-22.<br />
[2] LIU P,WANG C.Computational advertising:market and technology of Internet business realization [M].Beijing:The People’s Posts and Telecommunications Press,2015.(in Chinese)<br />
刘鹏,王超.计算广告:互联网商业变现的市场与技术[M].北京:人民邮电出版社,2015.<br />
[3] WANG J,ZHANG W,YUAN S.Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting [J].Foundations & Trends in Information Retrieval,2017,11(4-5):297-435.<br />
[4] 李航.统计学习方法[M].北京:清华大学出版社,2012.<br />
[5] 伊恩·古德费洛,约书亚·本吉奥,亚伦·库维尔.深度学习[M].赵申剑,黎彧君,符天凡,等译.北京:人民邮电出版社,2017.<br />
[6] BECK J E,WOOLF B P.High-level Student Modeling with Machine Learning[M]∥Intelligent Tutoring Systems.Berlin,Germany,2000:584-593.<br />
[7] ZHANG W,DU T,WANG J.Deep Learning over Multi-field Categorical Data:A Case Study on User Response Prediction[C]∥Proceedings of European Conference on Information Retrieval.Switzerland Cham:Springer,2016:45-57.<br />
[8] CHENG H T,KOC L,HARMSEN J,et al.Wide & Deep Learning for Recommender Systems[C]∥The Workshop on Deep Learning for Recommender Systems.Boston,USA,2016:7-10.<br />
[9] GUO H,TANG R,YE Y,et al.DeepFM:A Factorization-Machine based Neural Network for CTR Prediction[C]∥Procee-dings of the Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne,Australia,2017:1725-1731.<br />
[10] WANG R,FU B,FU G,et al.Deep & Cross Network for Ad Click Predictions[C]∥Proceedings of AdKDD and TargetAd.Halifax,2017:1-7 .<br />
[11] BOTTOU L.Online Learning and Neural Networks[M].Cambridge,UK:Cambridge University Press,1998.<br />
[12] ZINKEVICH M.Online Convex Programming and Generalized Infinitesimal Gradient Ascent:Technical Report CMU-CS-03-110[R].Carnegie Mellon University,2003.<br />
[13] DUCHI J,SINGER Y.Efficient Online and Batch Learning Using Forward Backward Splitting[J].Journal of Machine Learning Research,2009,10(18):2899-2934.<br />
[14] XIAO L.Dual Averaging Methods for Regularized Stochastic Learning and Online Optimization[J].Journal of Machine Learning Research,2010,11(1):2543-2596.<br />
[15] MCMAHAN H B,HOLT G,SCULLEY D,et al.Ad click prediction:a view from the trenches[C]∥ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.Chicago,2013:1222-1230.<br />
[16] CHANG Y W,HSIEH C J,CHANG K W,et al.Training and Testing Low-degree Polynomial Data Mappings via Linear SVM[J].Journal of Machine Learning Research,2014,11(11):1471-1490.<br />
[17] OENTARYO R J,LIM E P,LOW J W,et al.Predicting response in mobile advertising with hierarchical importance-aware factorization machine[C]∥ACM International Conference on Web Search and Data Mining.New York,USA:ACM,2014:123-132.<br />
[18] RENDLE S.Factorization Machines with libFM[J].Acm Transactions on Intelligent Systems & Technology,2012,3(3):1-22.<br />
[19] JUAN Y,ZHUANG Y,CHIN W S,et al.Field-aware Factorization Machines for CTR Prediction[C]∥ACM Conference on Recommender Systems.Boston MA,USA:ACM,2016:43-50.<br />
[20] HE X R,PAN J F,JIN O,et al.Practical lessons from predicting clicks on ads at facebook [C]∥ACM SIGKDD Conference on Knowledge Discovery and Data Mining.New York,USA,2014:1-9.<br />
[21] ZHOU Z H.Ensemble Methods:Foundations and Algorithms [M].New York:CRC press,2012.<br />
[22] JUAN Y C,CHIN W S,ZHUANG Y.kaggle-2014-criteo[DB/OL].[2018-07-12].ttps://<br />
[23] KRIZHEVSKY A,SUTSKEVER I,HINTON G.ImageNet Classification with Deep Convolutional Neural Networks[J].Advances in neural information processing systems,2012,25(2):1097-1105.<br />
[24] ALEX G,ABDEL-RAHMAN M,GEOFFREY H.Speech re- cognition with deep recurrent neural networks [C]∥IEEE International Conference on Acoustics,Speech and Signal Proces-sing.Vancouver,Canada,2013:6645-6649.<br />
[25] SHEN Y L,HE X D,GAO J F,et al.A latent semantic model with convolutional-pooling structure for information retrieval [C]∥ACM International Conference on Conference on Information and Knowledge Management.Shanghai,China,2014:101-110.<br />
[26] 周志华.机器学习[M].北京:清华大学出版社,2016:114.<br />
[27] QU Y R,CAI H,REN K,et al.Product-based neural networks for user response prediction[C]∥IEEE International Confe-rence on Data Mining.Barcelona,Spain,2016:1-6.<br />
[28] LIAO H R,PENG L X,LIU Z C,et al.Ipinyou global rtb bidding algorithm competition dataset[C]∥ACM SIGKDD Confe-rence on Knowledge Discovery and Data Mining.New York,USA,2014:1-6.<br />
[29] MURPHY K P.Machine Learning:A Probabilistic Perspective[M].Boston:MIT,2012.<br />
[30] HE H,GARCIA E A.Learning from imbalanced data[J].IEEE Transactions on Knowledge and Data Engineering,2009,21(9):1263-1284.<br />
[31] XIE Q Z,DAI Z H,DU Y L,et al.Controllable Invariance through Adversarial Feature Learning[C]∥31st Conference on Neural Information Processing Systems.Long Beach,CA,USA,2017.<br />
[32] DENG Y,SHEN Y,JIN H,et al.Disguise Adversarial Networks for Click-through Rate Prediction[C]∥Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne.Australia,2017:1589-1595.<br />
[33] SU Y H,JIN Z M,CHEN Y,et al.Improving Click-Through Rate Prediction Accuracy in Online Advertising by Transfer Learning [C]∥Proceedings of WI 17.Leipzig,Germany,2017.<br />
[34] ZHANG W,ZHOU T,WANG J,et al.Bid-aware Gradient Descent for Unbiased Learning with Censored Data in Display Advertising[C]∥ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.San Francisco,CA,USA,2016:665-674.<br />
[35] JASON Y,JEFF C,YOSHUA B,et al.How transferable are features in deep neural networks[C]∥Advances in Neural Information Processing Systems.Montreal,Canada,2014:3320-3328.<br />
[36] XIAO J,YE H,HE X N.Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks[C]∥Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence.Melbourne,Australia,2017:3119-3125.<br />
[37] HE X G,CHUA T S.Neural Factorization Machines for Sparse Predictive Analytics[C]∥The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.Shinjuku,Tokyo,Japan,2017:355-364.<br />
[38] CHEN J,SUN B,LI H,et al.Deep CTR Prediction in Display Advertising[C]∥The 2016 ACM Multimedia Conference.Amsterdam,Netherlands,2016:811-820.<br />
[39] CHAPELLE O,MANAVOGLU E,ROSALES R.Simple and Scalable Response Prediction for Display Advertising [J].ACM Transactions on Intelligent Systems and Technology,2014,5(4):1-34.<br />
[40] LEE K C,ORTEN B,DASDAN A,et al.Estimating Conver- sion Rate in Display Advertising From Past Performance Data [C]∥Proceedings of the 18<sup>th</sup> ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM press,2012:768-776.<br />
[41] GRAEPEL T,CANDELA Q,BORCHERT T,et al.Web-scale Bayesian Click-throuth Rate Prediction for Sponsored Search Advertising in Microsoft’s Bing Search Engine [C]∥Procee-dings of the 27<sup>th</sup> International Conference on Machine Learning.Israel:Omnipress,2010:13-20.<br />
[42] RICHARDSON M,DOMINOWSKA E,RAGNO R.Predicting Clicks:Estimating the Click-through Rate for New Ads[C]∥International Conference on World Wide Web.Canada:ACM,2007:521-530.
[1] MA Lu, PEI Wei, ZHU Yong-ying, WANG Chun-li, WANG Peng-qian. Fall Action Recognition Based on Deep Learning [J]. Computer Science, 2019, 46(9): 106-112.
[2] LI Qing-hua, LI Cui-ping, ZHANG Jing, CHEN Hong, WANG Shao-qing. Survey of Compressed Deep Neural Network [J]. Computer Science, 2019, 46(9): 1-14.
[3] WANG Yan-ran, CHEN Qing-liang, WU Jun-jun. Research on Image Semantic Segmentation for Complex Environments [J]. Computer Science, 2019, 46(9): 36-46.
[4] SUN Zhong-feng, WANG Jing. RCNN-BGRU-HN Network Model for Aspect-based Sentiment Analysis [J]. Computer Science, 2019, 46(9): 223-228.
[5] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
[6] ZHOU Yan, ZENG Fan-zhi, WU Chen, LUO Yue, LIU Zi-qin. 3D Shape Feature Extraction Method Based on Deep Learning [J]. Computer Science, 2019, 46(9): 47-58.
[7] DENG Cun-bin, YU Hui-qun, FAN Gui-sheng. Integrating Dynamic Collaborative Filtering and Deep Learning for Recommendation [J]. Computer Science, 2019, 46(8): 28-34.
[8] DU Wei, DING Shi-fei. Overview on Multi-agent Reinforcement Learning [J]. Computer Science, 2019, 46(8): 1-8.
[9] GUO Xu, ZHU Jing-hua. Deep Neural Network Recommendation Model Based on User Vectorization Representation and Attention Mechanism [J]. Computer Science, 2019, 46(8): 111-115.
[10] ZHANG Yi-jie, LI Pei-feng, ZHU Qiao-ming. Event Temporal Relation Classification Method Based on Self-attention Mechanism [J]. Computer Science, 2019, 46(8): 244-248.
[11] LI Zhou-jun,WANG Chang-bao. Survey on Deep-learning-based Machine Reading Comprehension [J]. Computer Science, 2019, 46(7): 7-12.
[12] ZHANG Lin-na,CHEN Jian-qiang,CHEN Xiao-ling,CEN Yi-gang,KAN Shi-chao. Lightweight SSD Network for Real-time Object Detection in Automotive Videos [J]. Computer Science, 2019, 46(7): 233-237.
[13] LI Jian, YANG Xiang-ru, HE Bin. Geometric Features Matching with Deep Learning [J]. Computer Science, 2019, 46(7): 274-279.
[14] ZHANG Shuai, FU Xiang-ling, HOU Yi. Prediction Model of P2P Trading Volume Based on Investor Sentiment [J]. Computer Science, 2019, 46(6A): 60-65.
[15] CHEN Si-wen, LIU Yu-jiang, LIU Dong, SU Chen, ZHAO Di, QIAN Lin-xue, ZHANG Pei-heng. AlexNet Model and Adaptive Contrast Enhancement Based UltrasoundImaging Classification [J]. Computer Science, 2019, 46(6A): 146-152.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75, 88 .
[2] ZHONG Fei and YANG Bin. License Plate Detection Based on Principal Component Analysis Network[J]. Computer Science, 2018, 45(3): 268 -273 .
[3] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99, 116 .
[4] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111, 142 .
[5] WANG Zhen-wu, LV Xiao-hua and HAN Xiao-hui. Survey of Terrain LOD Technology Based on Quadtree Segmentation[J]. Computer Science, 2018, 45(4): 34 -45 .
[6] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[7] HAN Kui-kui, XIE Zai-peng and LV Xin. Fog Computing Task Scheduling Strategy Based on Improved Genetic Algorithm[J]. Computer Science, 2018, 45(4): 137 -142 .
[8] PANG Bo, JIN Qian-kun, HENIGULI·Wu Mai Er and QI Xing-bin. Routing Scheme Based on Network Slicing and ILP Model in SDN[J]. Computer Science, 2018, 45(4): 143 -147 .
[9] JIA Wei, HUA Qing-yi, ZHANG Min-jun, CHEN Rui, JI Xiang and WANG Bo. Mobile Interface Pattern Clustering Algorithm Based on Improved Particle Swarm Optimization[J]. Computer Science, 2018, 45(4): 220 -226 .
[10] WEI Qin-shuang, WU You-xi, LIU Jing-yu and ZHU Huai-zhong. Distinguishing Sequence Patterns Mining Based on Density and Gap Constraints[J]. Computer Science, 2018, 45(4): 252 -256 .