Computer Science

Computer Science ›› 2020, Vol. 47 ›› Issue (7): 213-219.doi: 10.11896/jsjkx.200300069

Special Issue: Network and communication

• Computer Network • Previous Articles     Next Articles

Multi-source Tree-based Scheduling Algorithm for Deadline-aware P2MP Inter-datacenter Transfers

ZHUANG Yi, YANG Jia-hai   

  1. Institute for Network Sciences and Cyberspace,Tsinghua University,Beijing 100084,China
    Beijing National Research Center for Information Science and Technology,Beijing 100084,China
  • Received:2020-03-10 Online:2020-07-15 Published:2020-07-16
  • About author:ZHUANG Yi,born in 1995,master.His main research interests include cloud computing,and resource scheduling.
    YANG Jia-hai,born in 1966,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include network mana-gement,network measurement and security,cloud computing and network functions virtualization.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China(61432009,61462009)

PDF (PC)

732

Abstract: With the growth of the data volume for cloud applications,more and more cloud service providers pay attention to inter-datacenter bulk transfer.The main challenge of inter-datacenter bulk transfer is how to find the best resource scheduling algorithm,which uses the least resources to transfer the user’s data to the specified destinations before the specified deadline.This paper proposes MSTB(Multi-Source Tree-Based) algorithm,an effective scheduling solution for deadline-aware P2MP inter-da-tacenter transfers.With the help of multi-source mechanism and multicast forwarding tree,MSTB outperforms the state-of-the-art method.Simulation experiments show that MSTB can increase the number of transfer requests accepted by up to 91% and increase effective throughput by up to 54% with short transfer completion time and low computation complexity.

Key words: Datacenter, Deadline-aware, Multi-source, Point-to-multipoint, Scheduling algorithm

CLC Number: 

  • TP302
[1]HONG C Y,KANDULA S,MAHAJAN R,et al.Achievinghigh utilization with software-driven WAN[C]//Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM.2013:15-26.
[2]JAIN S,KUMAR A,MANDAL S,et al.B4:Experience with a globally-deployed software defined WAN[J].ACM SIGCOMM Computer Communication Review,2013,43(4):3-14.
[3]SUN G,XU Z,YU H,et al.Toward SLAs guaranteed scalable VDC provisioning in cloud data centers[J].IEEE Access,2019,7:80219-80232.
[4]Multi-datacenter replication in cassandra[OL].http://www.datastax.com/dev/ blog/multi-datacenter-replication.
[5]Azure sql database now supports powerful geo-replication features for all service tiers[OL].https://goo.gl/aD5iRv.
[6]Mapping Netflix:Content Delivery Network Spans 233 Sites[OL].http://datacenterfrontier.com/mapping-netflix-content-delivery-network.
[7]KANDULA S,MENACHE I,SCHWARTZ R,et al.Calendaring for wide area networks[C]//Proceedings of the 2014 ACM Conference on SIGCOMM.2014:515-526.
[8]ZHANG H,CHEN K,BAI W,et al.Guaranteeing deadlines for inter-data center transfers[J].IEEE/ACM Transactions on Networking,2016,25(1):579-595.
[9]LUO L,YU H,YE Z,et al.Online deadline-aware bulk transfer over inter-datacenter wans[C]//IEEE INFOCOM 2018-IEEE Conference on Computer Communications.IEEE,2018:630-638.
[10]JALAPARTI V,BLIZNETS I,KANDULA S,et al.Dynamicpricing and traffic engineering for timely inter-datacenter transfers[C]//Proceedings of the 2016 ACM SIGCOMM Confe-rence.2016:73-86.
[11]LUO L,KONG Y,NOORMOHAMMADPOUR M,et al.Deadline-Aware Fast One-to-Many Bulk Transfers over Inter-Datacenter Networks[J].IEEE Transactions on Cloud Computing,2019,doi:10.1109/TCC.2019.2935435.
[12]NOORMOHAMMADPOUR M,RAGHAVENDRA C S,RAO S,et al.Dccast:Efficient point to multipoint transfers across datacenters[C]//9th Workshop on Hot Topics in Cloud Computing (HotCloud 17).2017.
[13]NOORMOHAMMADPOUR M,RAGHAVENDRA C S,KANDULA S,et al.QuickCast:Fast and efficient inter-datacenter transfers using forwarding tree cohorts[C]//IEEE INFOCOM 2018-IEEE Conference on Computer Communications.IEEE,2018:225-233.
[14]ZHANG Y,JIANG J,XU K,et al.BDS:a centralized near-optimal overlay network for inter-datacenter data replication[C]//Proceedings of the Thirteenth EuroSys Conference.2018:1-14.
[15]JI S,LIU S,LI B.Deadline-aware scheduling and routing for inter-datacenter multicast transfers[C]//2018 IEEE International Conference on Cloud Engineering (IC2E).IEEE,2018:124-133.
[16]WANG Y,SU S,LIU A X,et al.Multiple bulk data transfers scheduling among datacenters[J].Computer Networks,2014,68:123-137.
[17]Tag:OpenFlow [OL].https://www.opennetworking.org/tag/openflow.
[18]Equinix Cloud Exchange Fabric [OL].https://www.equinix.com/interconnection-services/cloud-exchange-fabric.
[19]BANG-JENSEN J,GUTIN G Z.Digraphs:theory,algorithms and applications[M].Springer Science & Business Media,2008.
[1] CHEN Jing, WU Ling-ling. Mixed Attribute Feature Detection Method of Internet of Vehicles Big Datain Multi-source Heterogeneous Environment [J]. Computer Science, 2022, 49(8): 108-112.
[2] WU Cheng-feng, CAI Li, LI Jin, LIANG Yu. Frequent Pattern Mining of Residents’ Travel Based on Multi-source Location Data [J]. Computer Science, 2021, 48(7): 155-163.
[3] LIU Zhi-xin, ZHANG Ze-hua, ZHANG Jie. Top-N Recommendation Method for Graph Attention Based on Multi-level and Multi-view [J]. Computer Science, 2021, 48(4): 104-110.
[4] KUANG Guang-sheng, GUO Yan, YU Xiao-ming, LIU Yue, CHENG Xue-qi. Study on Multi-source Data Fusion Framework Based on Graph [J]. Computer Science, 2021, 48(11): 170-175.
[5] JI Nan-xun, SUN Xiao-yan, LI Zhen-qi. Fusion Vectorized Representation Learning of Multi-source Heterogeneous User-generated Contents [J]. Computer Science, 2021, 48(10): 51-58.
[6] ZHANG Liang-cheng, WANG Yun-feng. Dynamic Adaptive Multi-radar Tracks Weighted Fusion Method [J]. Computer Science, 2020, 47(11A): 321-326.
[7] QIN Yi-xiu, WEN Yi-min, HE Qian. Multi-source Online Transfer Learning Algorithm for Classification of Data Streams with Concept Drift [J]. Computer Science, 2019, 46(1): 64-72.
[8] LIU Pan, LI Hua-kang and SUN Guo-zi. Risk Observing Method Based on Short-time Multi-source Regression Algorithm on P2P Platform [J]. Computer Science, 2018, 45(5): 97-101.
[9] JU Chun-hua, ZOU Jiang-bo, FU Xiao-kang. Design and Application of Big Data Credit Reporting Platform Integrating Blockchain Technology [J]. Computer Science, 2018, 45(11A): 522-526.
[10] LU Jia-wei, WANG Chen-hao, XIAO Gang and XU Jun. Research and Application of Cloud Push Platform Based on Multi-source and Heterogeneous Data [J]. Computer Science, 2016, 43(Z6): 533-537.
[11] LIN Qiang, WU Guo-wei, WAN An-min and YU Jun-shuai. Real Time Scheduling Algorithm for Temporal and Spatial Tasks in Wireless Networked Control Systems [J]. Computer Science, 2016, 43(Z11): 278-281.
[12] ZHANG Yan. Improved Scheduler of Credit [J]. Computer Science, 2016, 43(Z11): 264-267.
[13] CUI Yun-fei, WU Xiao-jin, DAI Ye, CHENG Xiao and GUO Gang. Adaptive Fault-tolerant Scheduling Algorithm for Unresponsive Task Based on Speculation [J]. Computer Science, 2016, 43(Z11): 11-15.
[14] LV Rui, WANG Shu-ying, SUN Lin-fu and PAN Hua. Research on Multi-source Heterogeneous Information Dynamic Integration Technology for Industrial-chain Coordination SaaS Platform [J]. Computer Science, 2016, 43(2): 19-25.
[15] ZHANG Tian-yu, GUAN Nan and DENG Qing-xu. Analysis of Real-time Performance of Algorithm Credit in Xen Virtual Machine [J]. Computer Science, 2015, 42(12): 115-119.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.