计算机科学 ›› 2012, Vol. 39 ›› Issue (9): 157-161.
• 数据库与数据挖掘 • 上一篇 下一篇
李奇原,刘杰,叶丹,许舒人
出版日期:
发布日期:
Online:
Published:
摘要： MapReduce Job的调度机制一直是学术研究的热点。在分析MapReduce数据流调度模型的基础上，提出一 种面向MapRcducc数据流的公平调度方法F1owS。该方法采用数据流池来分配资源以保证MapRcducc数据流的隔 离性，并且采用数据流池动态构建算法来确保资源的公平分配。实验表明，该调度方法可以有效提高Hadoop集群对 MapRcducc数据流的处理效率。
关键词: MapReduce数据流，资源管理，公平调度方法
Abstract: MapReduce Job scheduling has been paid great attention in academic research. Based on the analysis ofMi1 Reduce dataflow scheduling model,this paper presented a fair scheduling method for MapReduce dataflow-F1owS. This method can not only provide the isolation of MapReduce dataflow through dataflow pools, but also assure the fairness of resource allocation through dynamic construction algorithm. The results of experiences show that the proposed method can improve the processing efficiency of Hadoop Clusters.
Key words: MapReduce dataflow, Resource management, Fair scheduling
李奇原,刘杰,叶丹,许舒人. F1owS:一种MapReduce数据流公平调度方法[J]. 计算机科学, 2012, 39(9): 157-161. https://doi.org/
0 / / 推荐
导出引用管理器 EndNote|Reference Manager|ProCite|BibTeX|RefWorks
链接本文: https://www.jsjkx.com/CN/
https://www.jsjkx.com/CN/Y2012/V39/I9/157
Cited
首页