Improving the Task and Job Level Scheduling in Virtual MR Clusters
Abstract
Virtualized environments are appealing due to the fact they simplify cluster control, even as facilitating cost-powerful workload consolidation. As an end result, virtual machines in public clouds or private data centers have become the norm for strolling transactional programs like net offerings & virtual computers. To offer the proper scheduling scheme for this type of computing environment, we endorse in this paper a task-driven scheduling scheme (JoSS) from a tenant’s angle. JoSS presents now not best activity degree scheduling, but also map-mission degree scheduling & reduce-assignment stage scheduling. JoSS classifies MapReduce jobs primarily based on job scale & job type & designs the proper scheduling policy to time table magnificence of jobs. The purpose is to enhance statistics locality for each map tasks & reduce tasks, keep away from job hunger, & improve job execution overall performance. Two variations of JoSS are in addition added to one after the other achieves a better map-data locality & a faster task assignment.
Full Text:
PDFCopyright (c) 2017 Edupedia Publications Pvt Ltd
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
All published Articles are Open Access at https://journals.pen2print.org/index.php/ijr/
Paper submission: ijr@pen2print.org