混合云环境中数据敏感工作流调度

计算机科学 ›› 2015, Vol. 42 ›› Issue (Z11): 400-405.

混合云环境中数据敏感工作流调度

范菁,沈杰,熊丽荣

浙江工业大学计算机科学与技术学院杭州310023,浙江工业大学计算机科学与技术学院杭州310023,浙江工业大学计算机科学与技术学院杭州310023

出版日期:2018-11-14 发布日期:2018-11-14
基金资助:
本文受国家自然科学基金(61173097),浙江省重大科技专项重大工业项目(2013C01112),杭州市重大科技创新专项(20132011A16)资助

Scheduling Data Sensitive Workflow in Hybrid Cloud

FAN Jing, SHEN Jie and XIONG Li-rong

Online:2018-11-14 Published:2018-11-14

摘要/Abstract

摘要： 混合云环境下调度包含敏感数据的工作流主要考虑在满足数据安全性以及工作流截止时间的前提下,对工作流任务在混合云上进行分配,实现计算资源与任务的映射,并优化调度费用。采用了整数规划来建模求解包含数据敏感性、截止时间和调度费用3种约束条件的混合云工作流调度问题,同时为优化模型求解速度,基于“帕雷托最优”原理对工作流任务在混合云上的分配方案进行筛选以减小模型求解规模。实验表明,优先排除不合理的任务分配方案可有效减小整数规划模型的求解规模,缩短模型计算时间,在产生较小误差的情况下获得较优的调度结果。

关键词: 工作流调度,混合云,敏感性,整数规划

Abstract: Using public resources to extend the capacity of private cloud is an effective way for the enterprises to achieve high efficiency and elasticity in data storage and computing.Scheduling workflow with sensitive data in hybrid cloud needs to satisfy the requirements of data security and execution deadline.In order to minimize the monetary cost,the scheduler must decide which tasks should be run on the public cloud and on which computing resource each workflow task should be allocated.Integer linear program(ILP) was used to formulate workflow scheduling problem with three objectives,such as data sensibility,deadline and cost.For the purpose of reducing the solve time of ILP model,the task assignment filter strategy based on Pareo optimality theory was designed.The filter strategy can decrease the scale of task assignments,and reduce the mappings between tasks and resources of ILP model.Experiments show that removing the unreasonable task assignment before resource allocation can decrease the ILP model scale and reduce scheduling running time,while the method can obtain a good solution.

Key words: Workflow scheduling,Hybrid cloud,Sensitive,ILP

范菁,沈杰,熊丽荣. 混合云环境中数据敏感工作流调度[J]. 计算机科学, 2015, 42(Z11): 400-405. https://doi.org/

FAN Jing, SHEN Jie and XIONG Li-rong. Scheduling Data Sensitive Workflow in Hybrid Cloud[J]. Computer Science, 2015, 42(Z11): 400-405. https://doi.org/

参考文献

[1] 储雅,马廷淮,赵立成.云计算资源调度:策略与算法[J].计算机科学,2013,40(11):8-13
[2] Bittencourt L F,Madeira E R M,Fonseca N L S D,et al.Sche-duling in Hybrid Clouds[J].Communications Magazine IEEE,2012,50(9):42-47
[3] Topcuoglu H,Society I C,Wu M,et al.Perfor mance-effectiveand low-complexity task scheduling for heterogeneous computing[J].IEEE Transactions on Parallel & Distributed Systems,2002,13(3):260-274
[4] Bittencourt L F,Madeira E R M.A performance-oriented adaptive sche-duler for dependent tasks on grids[J].Concurrency & Computation Practice & Experience,2008,20(9):1029-1049
[5] Abrishami S,Naghibzadeh M,Epema D H J.Cost-driven sche-duling of grid workflows using Partial Critical Paths[C]∥ IEEE/ACM International Conference on Grid Computing.IEEE,2010:81-88
[6] Luiz F B,Madeira E R M.HCOC:a cost optimization algorithm for workflow scheduling in hybrid clouds[J].Journal of Internet Services & Applications,2011,2(3):207-227
[7] Marcon D S,Bittencourt L F,Dantas R,et al.Workflow specification and scheduling with security constraints in hybrid clouds[C]∥IEEE Latin American Conference on Cloud Computing & Communications.2013:29-34
[8] Genez T A L,Bittencourt L F,Madeira E R M.Workflow sche-duling for SaaS/PaaS cloud providers considering two SLA le-vels[C]∥IEEE Network Operations & Management Sympo-sium.IEEE,2012:906-912
[9] Bittencourt L F,Madeira E R M.Using Time Discretization to Schedule Scientific Workflows in Multiple Cloud Providers[C]∥IEEE Sixth International Conference on Cloud Computing.IEEE Computer Society,2013:123-130
[10] Zhang C,Chang E C.Processing of Mixed-Sensitivity Video Surveillance Streams on Hybrid Clouds[C]∥IEEE International Conference on Cloud Computing.IEEE,2014:9-16
[11] Li H,Li H.A Research of Resource Scheduling Strategy for Cloud Computing Based on Pareto Optimality M×N Production Model[C]∥International Conference on Management & Service Science.2011:1-5
[12] Floudas C A,Lin X.Mixed Integer Linear Programming in Process Scheduling:Modeling,Algorithms,and Applications[J].Annals of Operations Research,2005,139(1):131-162
[13] Stefansson H,Sigmarsdottir S,Jensson P,et al.Discrete and Continuous Time Representations and Mathematical Models for Large Production Scheduling Problems:a Case Study From the Pharmaceutical Industry[J].European Journal of Operational Research,2011,215(2):383-392

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed