Scalable Co-Scheduling Strategies in Distributed Computing

P. 18–25.

Toporkov V. V., Toporkova A. S., Tselishev A., Yemelyanov D. M.

In this paper, we present an approach to scalable co-scheduling in distributed computing for complex sets of interrelated tasks(jobs). The scalability means that schedules are formed for job models with various levels of task granularity, data replication policies, and processor resource and memory can be upgraded. The necessary of guaranteed job execution at the required quality of service causes taking into account the distributed environment dynamics, namely, changes in the number of jobs for servicing, volumes of computations, possible failures of processor nodes, etc. At a consequence, in the general case, a set of versions of scheduling, or a strategy, is required instead of a single version. We propose a callable model of scheduling based on multicriteria strategies. The choice of the specific schedule depends on the load level of the resource dynamics and is formed as a resource query which is sent to a local batch-job management system.

Keywords: стратегия, планирование, распределенные вычисления, задание, distributed computing, job, task, задача, co-scheduling, strategy, critical work, scalability, критическая работа, масштабирование

In book

Proceedings of the 2010 ACS/IEEE International Conference on Computer Systems and Applications, Hammamet, Tunisia, May 16-19th, 2010

Los Alamitos: IEEE CS Pre, 2010.