Computer Science ›› 2022, Vol. 49 ›› Issue (8): 49-55.doi: 10.11896/jsjkx.210700074

• Database & Big Data & Data Science • Previous Articles     Next Articles

Query Performance Prediction Based on Physical Operation-level Models

WANG Run-an, ZOU Zhao-nian   

  1. School of Computer Science and Technology,Harbin Institute of Technology,Harbin 150001,China
  • Received:2021-07-07 Revised:2021-12-09 Published:2022-08-02
  • About author:WANG Run-an,born in 1998,postgra-duate,is a student member of China Computer Federation.His main research interests include database systems and so on.
    ZOU Zhao-nian,born in 1979,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include database systems and big data analysis.
  • Supported by:
    National Natural Science Foundation of China(62072138) and Open Research Projects of Zhejiang Lab(2021KC0AB02).

Abstract: Query performance prediction (QPP) is an important issue in database systems.When there are concurrent transactions in a database system,the existing methods fail to establish an accurate model without changing query performance.In this paper,a new method is proposed to solve the QPP problem.The proposed method builds unit prediction models for various physical operations in the query and combines the unit models into a complete QPP model according to the query plan.It can describe the concurrency state of the database system by taking the statistical information as features.The proposed method only needs to use the basic means provided by the DBMS to obtain the database statistics required to build the model,without changing the DBMS or affecting the execution of the original workloads on the database system.We evaluate our techniques on various workloads including OLTP and OLAP.Experiments show that the proposed method outperforms the state-of-art QPP methods regardless of different query plans or different concurrency.

Key words: Database system status, Neural network, Physical operation, Query performance prediction (QPP), Query plan

CLC Number: 

  • TP392
[1]ZOLAKTAF Z,MILANI M,POTTINGER R.Facilitating SQL Query Composition and Analysis[C]//Proceedings of the ACM SIGMOD International Conference on Management of Data.Association for Computing Machinery,2020:209-224.
[2]HUAWEI.openGauss Database[EB/OL].
[3]BABCOCK B,CHAUDHURI S.Towards a robust query optimizer:A principled and practical approach[C]//Proceedings of the ACM SIGMOD International Conference on Management of Data.2005:119-130.
[4]MARCUS R,PAPAEMMANOUIL O.Plan-structured deepneural network models for query performance prediction[C]//Proceedings of the VLDB Endowment.2019:1733-1746.
[5]DUGGAN J,PAPAEMMANOUIL O,UPFAL E.Performance Prediction for Concurrent Database Workloads[C]//Procee-dings of the ACM SIGMOD International Conference on Management of Data.2011:337-348.
[6]ZHOU X,SUN J,LI G,et al.Query performance prediction for concurrent queries using graph embedding[J].Proceedings of the VLDB Endowment,2020,13(9):1416-1428.
[7]WU W,CHI Y,ZHU S,et al.Predicting query execution time:Are optimizer cost models really unusable?[C]//International Conference on Data Engineering.2013:1081-1092.
[8]XU X,LIU C,SONG D.SQLNet:Generating Structured Queries from Natural Language Without Reinforcement Learning[J].arXiv:1711.04436,2017.
[9]AKDERE M,ÇETINTEMEL U,RIONDATO M,et al.Lear-ning-based query performance modeling and prediction[C]//International Conference on Data Engineering.2012:390-401.
[10]WU W,CHI Y,HACIGÜMÜS H,et al.Towards predictingquery execution time for concurrent and dynamic database workloads[J].Proceedings of the VLDB Endowment,2013,6(10):925-936.
[11]ABOULNAGA A,CHAUDHURI S.Self-tuning histograms[J].ACM SIGMOD Record,1999,28(2):181-192.
[12]KIPF A,KIPF T,RADKE B,et al.Learned Cardinalities:Estimating Correlated Joins with Deep Learning[C]//9th Biennial Conference on Innovative Data Systems Research.Asilomar,CA,USA,2019:13-16.
[13]TAN J,ZHANG T,LI F,et al.iBTune:Individualized Buffer Tuning for Large-scale Cloud Databases[J].Proceedings of the VLDB Endowment,2019,12(10):1221-1234.
[14]ZHANG J,LIU Y,ZHOU K,et al.An end-to-end automatic cloud database tuning system using deep reinforcement learning[C]//Proceedings of the ACM SIGMOD International Confe-rence on Management of Data.Association for Computing Machinery.2019:415-432.
[15]MARCUS R,PAPAEMMANOUIL O.Deep ReinforcementLearning for Join Order Enumeration[C]//Proceedings of the First International Workshop on Exploiting Artificial Intelligence Techniques for Data Management.New York,USA:ACM,2018:1-4.
[16]POSTGRESQ L.Postgres monitoring stats[EB/OL].
[17]LEIS V,GUBICHEV A,MIRCHEV A,et al.How Good Are Query Optimizers,Really?[J].Proceedings of the VLDB Endowment,2016,9(3):204-215.
[1] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[2] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[5] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[6] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[7] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[8] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[9] YANG Bing-xin, GUO Yan-rong, HAO Shi-jie, Hong Ri-chang. Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition [J]. Computer Science, 2022, 49(7): 57-63.
[10] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[11] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[12] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[13] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[14] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[15] ZHAO Dong-mei, WU Ya-xing, ZHANG Hong-bin. Network Security Situation Prediction Based on IPSO-BiLSTM [J]. Computer Science, 2022, 49(7): 357-362.
Full text



No Suggested Reading articles found!