Computer Science ›› 2013, Vol. 40 ›› Issue (1): 112-117.

Previous Articles     Next Articles

New Mechanism of Monitoring on Hadoop Cloud Platform

  

  • Online:2018-11-16 Published:2018-11-16

Abstract: Job monitoring and resource managing mechanism in cloud computing platform arc the core functions. The tasks of job monitoring and resource managing in Hadoop are assigned to JobTracker which is implemented on receiving heartbeat message sending by slave node, so JobTracker is the bottleneck of Hadoop. A new mechanism of job monitoring and resource managing scheme was presented. In this scheme,job monitoring and resource managing arc separated from original JobTracker, but job monitoring function is still assigned to JobTracker node, and the resource managing function is accomplish by newly added resource monitoring node. JobTracker sends the necessary information of Objects to resource managing node by using a new method of delta updates algorithm. Resource managing node schedules tasks with heartbeat message, and returns the result to Job Tracker node. Experimental results show that the scheme implemenu monitoring node monitor job completely,makes JobTracker node more flexible and robust, reduces the loading of Job Tracker node, improves the efficiency of Hadoop platform.

Key words: Cloud computing, Hadoop, Task scheduling, Resource managing, Delta updating algorithm

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!