计算机科学 ›› 2017, Vol. 44 ›› Issue (Z6): 459-462.doi: 10.11896/j.issn.1002-137X.2017.6A.103

• 大数据与数据挖掘 • 上一篇    下一篇

数据中心实时交换系统的研究与实现

唐旭,王飞,李彤,张鹏   

  1. 西北核技术研究所数值模拟与软件研发中心 西安710024,西北核技术研究所数值模拟与软件研发中心 西安710024,清华大学计算机科学与技术系 北京100084,西北核技术研究所数值模拟与软件研发中心 西安710024
  • 出版日期:2017-12-01 发布日期:2018-12-01

Research and Implementation of Real-time Exchange System in Data Center

TANG Xu, WANG Fei, LI Tong and ZHANG Peng   

  • Online:2017-12-01 Published:2018-12-01

摘要: 针对数据中心对信息实时交换系统实时可靠传输数据流的应用需求,分析了数据中心传输数据流的特点,设计了实时交换系统架构,重点研究了信息系统可靠、实时传输数据的方法。采用线程控制模块和消息同步阻塞I/O模型实现了并发数据流的处理,基于循环缓存机制和双系统同步技术解决了突发数据流易丢包的难题,保证了系统的可靠性。为了确保经过数据中心的数据流的实时传输,减少系统处理过程中产生的时延,提出了QPTS(队列优先级驱动的任务调度)算法。该算法兼顾优先级、截止时间和剩余包数,实现了数据流的按需调度,提高了系统对交换数据流的处理速度。测试结果验证了算法的有效性以及系统的实时性和可靠性。

关键词: 实时交换,循环缓存,优先级,截止时间,剩余包数

Abstract: In view of real-time information exchange system(RIES)in data center,the applications require real-time and reliable transmission of data flow.This paper analyzed the features of data flow in data center,and proposed an architecture of RIES.Furthermore,this paper focused on the methods of reliable real-time data transmission.The methods uses the thread-control module and the message synchronous blocking I/O model to achieve the concurrent data flow processing.Moreover,the package loss of data flow is solved by using a loop caching mechanism,and the reliability of the system is ensured by double-system synchronized technique.In order to achieve real-time data transmission and decrease delay in the process of system processing,the queue priority based tasks scheduling (QPTS) algorithm was proposed.The algorithm implemented the on-demand scheduling of data flow,which is based on priority,deadline and amount of remaining packets,meanwhile it improved the processing speed of RIES.The evaluation results show the efficiency of the algorithm,and guarantee the real-time and reliability of the system.

Key words: Real-time exchange,Loop cache,Priority,Deadline,Amount of remaining packets

[1] HARITSA JAYANT R,CEREY MICHAEL J,LIVNY M.Va-lue-based scheduling in real-time database systems[J].VLDB Journal,1993,2(2):117-152.
[2] ALDARMI S A,BURNS A.Dynamic value-density for scheduling real-time systems[C]∥Proceedings of the 11th Euromicro Conference on Real-Time Systems,1999.York:England,UK,1999:270-277.
[3] LIU C L,LAYLAND JAMES W.Scheduling algorithms for mu-ltiprogramming in a hard real-time environment[J].Journal of the ACM,1973,20(1):46-61.
[4] LEUNG J,WHITEHEAD J.On the complexity of fixed-priority scheduling of periodic real-time tasks[J].Perfermance Evaluation,1982,2(4):237-250.
[5] MOK A.Fundamental design problems of distributed systemsfor the hard real-time environment [D].Cambridge:Massachusetts Institute of Technology,1983.
[6] HILDEBRANDT J,GOLATOWSKI F,TIMMEMANN D.Scheduling of hard-real-time tasks[J].IEEE Trans on Software Engineering,1989,15(12):1497-1506.
[7] 金宏,王宏安,王强,等.改进的最小空闲时间优先调度算法[J].软件学报,2004,5(8):1116-1123.
[8] Semghouni S,Amanton L,Sade B,et al.On new scheduling policy for the improvement of firm RTDBSs performance[J].Data & Knowledge Engineering,2007,3(2):414-432.
[9] 王永炎,王强,王宏安,等.基于优先级表的实时调度算法及其实现[J].软件学报,2004,15(3):360-370.
[10] 夏家莉,陈辉,杨兵.一种动态优先级实时任务调度算法[J].计算机学报,2012,35(12):2686-2695.
[11] MARCO C,GIORGIO B,LUI S.Handling execution overruns in hard real-time control systems[J].IEEE Transactions on Computer,2002,1(7):110-118.
[12] JENSEN E D,LOCKE C D,TODUDA H.A time-driven sche-duling model for real-time operating systems[C]∥the 6th IEEE Real-time System Symp,1985.San Diego:IEEE Computer So-ciety Press,1985:112-122.
[13] BUTTAZZO G,SPURI M,SENSINI F.Value vs.Deadline sch-eduling in overload conditions[C]∥the 19th IEEE Real-Time System Symp,1995.Pisa:IEEE Computer Society Press,1995:90-99.
[14] BIYABANI S R,STANKOVIC J A,R AMAMRITHAM K.The integration of deadline and criticalness in hard real-time scheduling[C]∥the 9th IEEE Real-Time System Symp,1988.Huntsville:IEEE Computer Society Press,1988:152-160.
[15] TSENG S M,CHIN Y H,YANG W P.Scheduling value-based transactions in real-time main-memory databases[M]∥LIN K J,ed.the First International Workshop on Real-Time Databa-ses:Issues and Applications.Newport Beach:Kluwer Academic Publishers,1996:111-117.
[16] BURNS A,PRASAD D,BONDAVALLI A,et al.The meaning and role of value in scheduling flexible real-time systems[J].Journal of Systems Architecture,2000,6(4):305-325.
[17] 胥光辉,徐永森.同步阻塞线程的唤醒问题研究[J].计算机科学,2002,9(12):49-50.
[18] LI T,XU K,SHEN M,et al.Towards Minimal Tardiness of Data-intensive Applications in Heterogeneous Networks[C]∥IEEE International Conference on Computer Communication and Networks (ICCCN),2016.Hawaii:IEEE Computer Society Press,2016:1-9.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!