Computer Science ›› 2024, Vol. 51 ›› Issue (2): 27-35.doi: 10.11896/jsjkx.231000141

• Database & Big Data & Data Science • Previous Articles     Next Articles

MMOS:Memory Resource Sharing Methods to Support Overselling in Multi-tenant Databases

XU Haiyang1,2, LIU Hailong1,2, YANG Chaoyun1, WANG Shuo1,2, LI Zhanhuai1,2   

  1. 1 School of Computer Science,Northwestern Polytechnical University,Xi'an 710100,China
    2 Key Laboratory of Big Data Storage and Management,Northwestern Polytechnical University,Ministry of Industry and Information Techno- logy,Xi'an 710100,China
  • Received:2023-10-20 Revised:2023-11-24 Online:2024-02-15 Published:2024-02-22
  • About author:XU Haiyang,born in 2000,postgra-duate,is a member of CCF(No.H3613G).His main research interests include big data management and analysis technology.LIU Hailong,born in 1980,Ph.D,associate professor,is a member of CCF(No.10265M).His main research interests include big data management and analysis technologies,data gover-nance technologies.
  • Supported by:
    National Natural Science Foundation of China (62172335) and CCF-Huawei Hoopwood Fund(CCF-HuaweiDBIR0004B).

Abstract: This paper presents an oversold memory resource sharing method for multi-tenant databases in an online analysis and processing scenario.The current static resource allocation strategy,which assigns a fixed resource quota to each tenant,leads to suboptimal resource utilization.To enhance resource utilization and platform revenue,it is important to share unused free resources among tenants without impacting their performance.While existing resource sharing methods for multi-tenant databases primarily focus on CPU resources,there is a lack of memory resource sharing methods that support overselling.To address this gap,the paper introduces a novel approach MMOS that accurately forecasts the memory requirements interval of each tenant and dynamically adjusts their resource allocation based on the upper limit of the interval.This allows for efficient management of free memory resources,enabling support for more tenants and achieving memory overselling while maintaining optimal performance.Experimental results demonstrate the effectiveness of the proposed method in dynamically changing tenant load scenarios.With different resource pools,the number of supported tenants can be increased by 2~2.6 times,leading to a significant increase in peak resource utilization by 175%~238%.Importantly,the proposed method ensures that the business and performance of each tenant remain unaffected.

Key words: Multi-tenant database, Resource overselling, Memory resources, Resource forecasting, Resource allocation

CLC Number: 

  • TP311.13
[1]RASHID A,CHATURVEDI A.Cloud computing characteris-tics and services:a brief review[J].International Journal of Computer Sciences and Engineering,2019,7(2):421-426.
[2]NARASAYYA V,CHAUDHURI S.Multi-Tenant Cloud Data Services:State-of-the-Art,Challenges and Opportunities[C]//Proceedings of the 2022 ACM SIGMOD International Confe-rence on Management of Data.2022:2465-2473.
[3]LIN W,XU S,HE L,et al.Multi-resource scheduling and power simulation for cloud computing[J].Information Sciences—Informatics and Computer Science,Intelligent Systems,Applications:An International Journal,2017,397(C):168-186.
[4]KUMAR K S S,JAISANKAR N.An automated resource mana-gement framework for minimizing SLA violations and negotiation in collaborative cloud[J].International Journal of Cognitive Computing in Engineering,2020,1:27-35.
[5]THEIN T,MYO M M,PARVIN S,et al.Reinforcement lear-ning based methodology for energy-efficient resource allocation in cloud data centers[J].Journal of King Saud University-Computer and Information Sciences,2020,32(10):1127-1139.
[6]ZHAO Y,CALHEIROS R N,GANGE G,et al.SLA-basedprofit optimization resource scheduling for big data analytics-as-a-service platforms in cloud computing environments[J].IEEE Transactions on Cloud Computing,2018,9(3):1236-1253.
[7]WANG Y,HE Q,ZHANG X,et al.Efficient QoS-aware service recommendation for multi-tenant service-based systems in cloud[J].IEEE Transactions on Services Computing,2017,13(6):1045-1058.
[8]LIU L.Qos-aware machine learning-based multiple resourcesscheduling for microservices in cloud environment[J].arXiv:1911.13208,2019.
[9]QI B,ZHANG P,WU H,et al.Cloud Resource SchedulingMethod based on Markov Process and the Cuckoo Search[C]//Journal of Physics:Conference Series.IOP Publishing,2022,2320(1):12-30.
[10]IMDOUKH M,AHMAD I,ALFAILAKAWI M G.Machinelearning-based auto-scaling for containerized applications[J].Neural Computing and Applications,2020,32:9745-9760.
[11]SINGH S T,TIWARI M,DHAR A S.Machine Learning based Workload Prediction for Auto-scaling Cloud Applications[C]//2022 OPJU International Technology Conference on Emerging Technologies for Sustainable Development(OTCON).IEEE,2023:1-6.
[12]HIGGINSON A S,DEDIU M,ARSENE O,et al.Databaseworkload capacity planning using time series analysis and machine learning[C]//Proceedings of the 2020 ACM SIGMOD,International Conference on Management of Data.2020:769-783.
[13]KHOLIDY H A.An intelligent swarm based prediction ap-proach for predicting cloud computing user resource needs[J].Computer Communications,2020,151:133-144.
[14]CHEN J,WANG Y.A Hybrid Method for Short-Term HostUtilization Prediction in Cloud Computing[J].Journal of Electrical & Computer Engineering,2019,2019:33-46.
[15]QIU C,SHEN H.Dynamic demand prediction and allocation in cloud service brokerage[J].IEEE Transactions on Cloud Computing,2019,9(4):1439-1452.
[16]QADER W A,AMEEN M M,AHMED B I.An overview of bag of words;importance,implementation,applications,and challenges[C]//2019 International Engineering Conference(IEC).IEEE,2019:200-204.
[17]LI Y,YANG T.Word embedding for understanding natural language:a survey[J].Guide to Big Data Applications,2018,4(4):83-104.
[18]ZHAO C,WANG S,FENG X,et al.An Improved Term Frequency-Inverse Document Frequency Method Solving Multi-Text Label Problem[C]//2022 Global Conference on Robotics,Artificial Intelligence and Information Technology(GCRAIT).IEEE,2022:400-404.
[19]CHEN T,GUESTRIN C.Xgboost:A scalable tree boostingsystem[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:785-794.
[1] LUO Junren, ZOU Mingwo, CHEN Shaofei, ZHANG Wanpeng, CHEN Jing. Research Progress on Colonel Blotto Game Models and Solving Methods [J]. Computer Science, 2024, 51(1): 84-98.
[2] CHEN Yipeng, YANG Zhe, GU Fei, ZHAO Lei. Resource Allocation Strategy Based on Game Theory in Mobile Edge Computing [J]. Computer Science, 2023, 50(2): 32-41.
[3] LI Xiaohuan, CHEN Bitao, KANG Jiawen, YE Jin. Coalition Game-assisted Joint Resource Optimization for Digital Twin-assisted Edge Intelligence [J]. Computer Science, 2023, 50(2): 42-49.
[4] YU Bin, LI Xue-hua, PAN Chun-yu, LI Na. Edge-Cloud Collaborative Resource Allocation Algorithm Based on Deep Reinforcement Learning [J]. Computer Science, 2022, 49(7): 248-253.
[5] TANG Feng, FENG Xiang, YU Hui-qun. Multi-task Cooperative Optimization Algorithm Based on Adaptive Knowledge Transfer andResource Allocation [J]. Computer Science, 2022, 49(7): 254-262.
[6] LI Meng-fei, MAO Ying-chi, TU Zi-jian, WANG Xuan, XU Shu-fang. Server-reliability Task Offloading Strategy Based on Deep Deterministic Policy Gradient [J]. Computer Science, 2022, 49(7): 271-279.
[7] ZHOU Tian-qing, YUE Ya-li. Multi-Task and Multi-Step Computation Offloading in Ultra-dense IoT Networks [J]. Computer Science, 2022, 49(6): 12-18.
[8] QIU Xu, BIAN Hao-bu, WU Ming-xiao, ZHU Xiao-rong. Study on Task Offloading Algorithm for Internet of Vehicles on Highway Based on 5G MillimeterWave Communication [J]. Computer Science, 2022, 49(6): 25-31.
[9] XU Hao, CAO Gui-jun, YAN Lu, LI Ke, WANG Zhen-hong. Wireless Resource Allocation Algorithm with High Reliability and Low Delay for Railway Container [J]. Computer Science, 2022, 49(6): 39-43.
[10] SHEN Jia-fang, QIAN Li-ping, YANG Chao. Non-orthogonal Multiple Access and Multi-dimension Resource Optimization in EH Relay NB-IoT Networks [J]. Computer Science, 2022, 49(5): 279-286.
[11] PAN Yan-na, FENG Xiang, YU Hui-qun. Competitive-Cooperative Coevolution for Large Scale Optimization with Computation Resource Allocation Pool [J]. Computer Science, 2022, 49(2): 182-190.
[12] WU Yun-han, BAI Guang-wei, SHEN Hang. Multi-dimensional Resource Dynamic Allocation Algorithm for Internet of Vehicles Based on Federated Learning [J]. Computer Science, 2022, 49(12): 59-65.
[13] YUAN Xin-wang, XIE Zhi-dong, TAN Xin. Survey of Resource Management Optimization of UAV Edge Computing [J]. Computer Science, 2022, 49(11): 234-241.
[14] WANG Ying-kai, WANG Qing-shan. Reinforcement Learning Based Energy Allocation Strategy for Multi-access Wireless Communications with Energy Harvesting [J]. Computer Science, 2021, 48(7): 333-339.
[15] SONG Hai-ning, JIAO Jian, LIU Yong. Research on Mobile Edge Computing in Expressway [J]. Computer Science, 2021, 48(6A): 383-386.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!