Computer Science ›› 2021, Vol. 48 ›› Issue (4): 261-267.doi: 10.11896/jsjkx.200800023

• Computer Network • Previous Articles     Next Articles

Survey of Resource Scheduling for Serverless Platforms

MA Ze-hua1, LIU Bo1, LIN Wei-wei2, LI Jia-wei1   

  1. 1 School of Computer Science,South China Normal University,Guangzhou 510631,China
    2 School of Computer Science and Engineering,South China University of Technology,Guangzhou 510641,China
  • Received:2020-06-24 Revised:2020-09-10 Online:2021-04-15 Published:2021-04-09
  • About author:MA Ze-hua,born in 1996,postgraduate.His main research interests include cloud computing and container scheduling.(mzh.scnu@qq.com)
    LIN Wei-wei,born in 1980,Ph.D,professor,is a member of China Computer Federation.His main research interests include cloud computing,big data technology and AI application technology.
  • Supported by:
    National Natural Science Foundation of China (61872084,61772205),Guangdong Major Project of Basic and Applied Basic Research (2019B030302002) and Guangzhou Science and Technology Plan Project (202007040002,201902010040).

Abstract: Serverless computing is emerging as a promising paradigm for deploying cloud applications.It really implements pay-as-you-go billing without wasting resources.Developers don’t have to worry about the low-level details of the computing platform,they just need to pay when processing requests or events,thus lowering the threshold for developers.Although the change of serverless model brings opportunities,it also brings problems such as cold startup delay of platform function and insufficient resource utilization.Therefore,this paper makes an in-depth investigation and analysis of the resource scheduling technology of the serverless computing platform.The technical principle and research status of resource scheduling in serverless platform based on resource utilization,response time delay and multi-objective optimization are discussed.Finally,this paper points out the trends of future research directions:scheduling for different application types,the tradeoff between response time and resource utilization,joint scheduling between virtual machine and serverless platform,and hybrid algorithm for serverless resource scheduling.

Key words: Functions as a services, Resource scheduling, Serverless computing

CLC Number: 

  • TP393
[1]KILCIOGLU C,RAO J M,KANNAN A,et al.Usage patterns and the economics of the public cloud[C]//Proceedings of the 26th International Conference on World Wide Web.2017:83-91.
[2]CNCF Serverless Whitepaper v1.0[EB/OL].(2020-05-23)[2020-08-31].https://github.com/cncf/wg-serverless#white-paper.
[3]MCGRATH G,BRENNER P R.Serverless computing:Design,implementation,and performance[C]//2017 IEEE 37th International Conference on Distributed Computing Systems Workshops(ICDCSW).IEEE,2017:405-410.
[4]Global Forecast to 2021:Increasing shift from DevOps to serverless computing to drive the overall Function-as-a-Service market[EB/OL].(2017-06-15)[2020-08-31].https://www.businesswire.com/news/home/20170227006262/en/7.72-Billion-Function-as-a-Service-Market-2017---Global.
[5]DELIMITROU C,KOZYRAKIS C.Quasar:resource-efficientand QoS-aware cluster management[J].ACM SIGPLAN Notices,2014,49(4):127-144.
[6]GAN Y,ZHANG Y,CHENG D,et al.An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems[C]//Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems.2019:3-18.
[7]MAHMOUDI N,LIN C,KHAZAEI H,et al.Optimizing serverless computing:introducing an adaptive function placement algorithm[C]//Proceedings of the 29th Annual International Conference on Computer Science and Software Engineering.2019:203-213.
[8]CASTRO P,ISHAKIAN V,MUTHUSAMY V,et al.The rise of serverless computing[J].Communications of the ACM,2019,62(12):44-54.
[9]ISHAKIAN V,MUTHUSAMY V,SLOMINSKI A.Servingdeep learning models in a serverless platform[C]//2018 IEEE International Conference on Cloud Engineering(IC2E).IEEE,2018:257-262.
[10]BALDINI I,CASTRO P,CHANG K,et al.Serverless computing:Current trends and open problems[M]//Research Advances in Cloud Computing.Springer,Singapore,2017:1-20.
[11]HELLERSTEIN J M,FALEIRO J,GONZALEZ J E,et al.Serverless computing:One step forward,two steps back[J].arXiv:1812.03651,2018.
[12]FOX G C,ISHAKIAN V,MUTHUSAMY V,et al.Status of serverless computing and function-as-a-service(faas) in industry and research[J].arXiv:1708.08028,2017.
[13]ADZIC G,CHATLEY R.Serverless computing:economic andarchitectural impact[C]//Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering.2017:884-889.
[14]JONAS E,SCHLEIER-SMITH J,SREEKANTI V,et al.Cloud programming simplified:A berkeley view on serverless computing[J].arXiv:1902.03383,2019.
[15]WANG L,LI M,ZHANG Y,et al.Peeking behind the curtains of serverless platforms[C]//Annual Technical Conference.2018:133-146.
[16]SURESH A,GANDHI A.FnSched:An Efficient Scheduler for Serverless Functions[C]//Proceedings of the 5th International Workshop on Serverless Computing.2019:19-24.
[17]LEE H,SATYAM K,FOX G.Evaluation of production serverless computing environments[C]//2018 IEEE 11th Internatio-nal Conference on Cloud Computing(CLOUD).IEEE,2018:442-450.
[18]WAGNER T.Optimizing Enterprise Economics with Serverless Architectures[Z].AWS Web Serviced,2017.
[19]Netflix & AWS Lambda Case Study[EB/OL].(2020-08-18)[2020-08-31].https://aws.amazon.com/cn/solutions/case-studies/netflix-and-aws-lambda/.
[20]WU D,ROSEN D W,WANG L,et al.Cloud-based design and manufacturing:A new paradigm in digital manufacturing and design innovation[J].Computer-Aided Design,2015,59:1-14.
[21]KAFFES K,YADWADKAR N J,KOZYRAKIS C.Centralized Core-granular Scheduling for Serverless Functions[C]//Proceedings of the ACM Symposium on Cloud Computing.2019:158-164.
[22]JIANG Q,LEE Y C,ZOMAYA A Y.Serverless execution of scientific workflows[C]//International Conference on Service-Oriented Computing.Springer,Cham,2017:706-721.
[23]PÉREZ A,MOLTÓ G,CABALLER M,et al.Serverless compcuting for container-based architectures[J].Future Generation Computer Systems,2018,83:50-59.
[24]BALDINI I,CHENG P,FINK S J,et al.The serverless trilemma:Function composition for serverless computing[C]//Proceedings of the 2017 ACM SIGPLAN International Symposium on New Ideas,New Paradigms,and Reflections on Programming and Software.2017:89-103.
[25]LLOYD W,VU M,ZHANG B,et al.Improving Application Migration to Serverless Computing Platforms:Latency Mitigation with Keep-Alive Workloads[C]//2018 IEEE/ACM Internatio-nal Conference on Utility and Cloud Computing Companion(UCC Companion).IEEE,2018:195-200.
[26]MANNER J,ENDREβ M,HECKEL T,et al.Cold start influencing factors in function as a service[C]//2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion(UCC Companion).IEEE,2018:181-188.
[27]VAN E E,IOSUP A,ABAD C L,et al.A SPEC RG cloudgroup’s vision on the performance challenges of FaaS cloud architectures[C]//Companion of the 2018 ACM/SPEC International Conference on Performance Engineering.2018:21-24.
[28]ABAD C L,BOZA E F,VAN EYK E.Package-aware scheduling of FaaS functions[C]//Companion of the 2018 ACM/SPEC International Conference on Performance Engineering.2018:101-106.
[29]OAKES E,YANG L,HOUCK K,et al.Pipsqueak:Lean Lambdas with large libraries[C]//2017 IEEE 37th International Conference on Distributed Computing Systems Workshops(ICDCSW).IEEE,2017:395-400.
[30]TOTOY G,BOZA E F,ABAD C L.An Extensible Scheduler for the OpenLambda FaaS Platform[C]//Min-Move workshop(co-located with ASPLOS).2018.
[31]HENDRICKSON S,STURDEVANT S,HARTER T,et al.Serverless computation with openlambda[C]//8th(USENIX)Workshop on Hot Topics in Cloud Computing(HotCloud 16).2016.
[32]KARGER D,SHERMAN A,BERKHEIMER A,et al.Web caching with consistent hashing[J].Computer Networks,1999,31(11-16):1203-1213.
[33]STOICA I,MORRIS R,KARGER D,et al.Chord:A scalablepeer-to-peer lookup service for internet applications[J].ACM SIGCOMM Computer Communication Review,2001,31(4):149-160.
[34]NASIR A,MORALES G D F,GARCíA-SORIANO D,et al.The Power of Both Choices:Practical Load Balancing for Distributed Stream Processing Engines[J].arXiv:1504.00788v1,2015.
[35]AUMALA G,BOZA E,ORTIZ-AVILES L,et al.Beyond Load Balancing:Package-Aware Scheduling for Serverless Platforms[C]//2019 19th IEEE/ACM International Symposium on Cluster,Cloud and Grid Computing(CCGRID).2019:282-291.
[36]BERMBACH D,KARAKAYA A S,BUCHHOLZ S.Using application knowledge to reduce cold starts in FaaS services[C]//Proceedings of the 35th Annual ACM Symposium on Applied Computing.2020:134-143.
[37]RODRIGUEZ M A,BUYYA R.Deadline based resource provisioningand scheduling algorithm for scientific workflows on clouds[J].IEEE transactions on cloud computing,2014,2(2):222-235.
[38]RYAN T,LEE Y C.Effective resource multiplexing for scienti-fic workflows[C]//2015 17th Asia-Pacific Network Operations and Management Symposium(APNOMS).IEEE,2015:232-237.
[39]ALQARYOUTI O,SIYAM N.Serverless Computing andScheduling Tasks on Cloud:A Review[J].American Scientific Research Journal for Engineering,Technology,and Sciences(ASRJETS),2018,40(1):235-247.
[40]STEIN M.The Serverless Scheduling Problem and NOAH[J].arXiv:1809.06100v1,2018.
[41]QUEVEDO S,MERCHÁN F,RIVADENEIRA R,et al.Evaluating Apache OpenWhisk-FaaS[C]//2019 IEEE Fourth Ecuador Technical Chapters Meeting(ETCM).IEEE,2019:1-5.
[42]HOSEINYFARAHABADY M R,LEE Y C,ZOMAYA A Y,et al.A QoS-aware resource allocation controller for function as a service(FaaS) platform[C]//International Conference on Ser-vice-Oriented Computing.Springer,Cham,2017:241-255.
[43]ENES J,EXPÓSITO R R,TOURIÑO J.Real-time resourcescaling platform for Big Data workloads on serverless environments[J].Future Generation Computer Systems,2020,105:361-379.
[44]GAND F,FRONZA I,EL IOINI N,et al.Serverless Container Cluster Management for Lightweight Edge Clouds[C]//CLOSER.2020:302-311.
[45]NASTIC S,RAUSCH T,SCEKIC O,et al.A serverless real-time data analytics platform for edge computing[J].IEEE Internet Computing,2017,21(4):64-71.
[46]CICCONETTI C,CONTI M,PASSARELLA A.An architectu-ral framework for serverless edge computing:design and emulation tools[C]//2018 IEEE International Conference on Cloud Computing Technology and Science(CloudCom).IEEE,2018:48-55.
[47]ZHANG H,STAFMAN L,OR A,et al.Slaq:quality-drivenscheduling for distributed machine learning[C]//Proceedings of the 2017 Symposium on Cloud Computing.2017:390-404.
[48]MARINI F,WALCZAK B.Particle swarm optimization(PSO).A tutorial[J].Chemometrics and Intelligent Laboratory Systems,2015,149:153-165.
[49]GUNTSCH M,MIDDENDORF M.A population based ap-proach for ACO[C]//Workshops on applications of evolutionary computation.Berlin,Heidelberg:Springer,2002:72-81.
[50]WANG J,CHEN H.BSAS:Beetle swarm antennae search algorithm for optimization problems[J].arXiv:1807.10470,2018.
[1] NING Yu-hui, YAO Xi. Design and Implementation of Emergency Command System [J]. Computer Science, 2021, 48(6A): 613-618.
[2] WANG Chen-xin, YANG Jia-hai, ZHUANG Yi, LUO Nian-long. Node Resource Scheduling for Future Network Experimentation Facility [J]. Computer Science, 2019, 46(12): 95-100.
[3] ZHAO Hong-wei, TIAN Li-wei. Cloud Computing Resource Scheduling Strategy Based on Improved Bacterial Foraging Algorithm [J]. Computer Science, 2019, 46(11): 309-314.
[4] YANG Xiao-lan, QIAN Cheng and ZHU Fu-xi. Evaluation Method of Big Data Service Resources Based on Cloud Computing [J]. Computer Science, 2018, 45(5): 295-299.
[5] YANG Dong-ju and DENG Chong-bin. Dynamic Scheduling Method of Virtual Resources Based on ARIMA Model [J]. Computer Science, 2017, 44(10): 14-18.
[6] ZHAO Hong-wei and LI Sheng-pu. Research on Resources Scheduling Method in Cloud Computing Based on PSO and RBF Neural Network [J]. Computer Science, 2016, 43(3): 113-117.
[7] ZHANG Heng-wei, HAN Ji-hong, WEI Bo and WANG Jin-dong. Research on Cloud Resource Scheduling Method Based on Map-Reduce [J]. Computer Science, 2015, 42(8): 118-123.
[8] ZHOU Li-juan and WANG Chun-ying. Cloud Computing Resource Scheduling in Mobile Internet Based on Particle Swarm Optimization Algorithm [J]. Computer Science, 2015, 42(6): 279-281.
[9] YUAN Hao and LI Chang-bing. Resource Scheduling Algorithm Based on Social Force Swarm Optimization Algorithm in Cloud Computing [J]. Computer Science, 2015, 42(4): 206-208.
[10] . Platform Resource Scheduling Method Based on DLS and ACO [J]. Computer Science, 2012, 39(6): 98-103.
[11] . Survey of Resource Scheduling in Cloud Computing [J]. Computer Science, 2012, 39(10): 1-6.
[12] QIAN Qiong-fen,LI Chun-lin, ZHANG Xiao-qing. Research on Cloud Economic Resource Management Model with QoS Constrains [J]. Computer Science, 2011, 38(Z10): 195-197.
[13] WANG Zhen-Ming,DU Zhi-Hui (Department of Computer Science and Technology, Tsinghua University, Beijing, 100084). [J]. Computer Science, 2006, 33(4): 80-84.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!