New Challenges of Parallel Job Scheduling

The workshop on job scheduling strategies for parallel processing (JSSPP) studies the myriad aspects of managing resources on parallel and distributed computers. These studies typically focus on large-scale computing environments, where allocation and management of computing resources present numerous challenges. Traditionally, such systems consisted of massively parallel supercomputers, or more recently, large clusters of commodity processor nodes. These systems are characterized by architectures that are largely homogeneous and workloads that are dominated by both computation and communication-intensive applications. Indeed, the large majority of the articles in the first ten JSSPP workshops dealt with such systems and addressed issues such as queuing systems and supercomputer workloads. In this paper, we discuss some of the recent developments in parallel computing technologies that depart from this traditional domain of problems. In particular, we identify several recent and influential technologies that could have a significant impact on the future of research on parallel scheduling. We discuss some of the more specific research challenges that these technologies introduce to the JSSPP community, and propose to enhance the scope of future JSSPP workshops to include these topics.

[1]  Manish Parashar,et al.  Grid Computing — GRID 2002 , 2002, Lecture Notes in Computer Science.

[2]  Terry Jones,et al.  Improving the Scalability of Parallel Jobs by adding Parallel Awareness to the Operating System , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[3]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[4]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[5]  Larry Rudolph,et al.  Job Scheduling Strategies for Parallel Processing: 7th International Workshop, JSSPP 2001, Cambridge, MA, USA, June 16, 2001, Revised Papers , 2001 .

[6]  Anca I. D. Bucur,et al.  Scheduling Policies for Processor Coallocation in Multicluster Systems , 2007, IEEE Transactions on Parallel and Distributed Systems.

[7]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[8]  Uwe Schwiegelshohn,et al.  Attributes for communication between Grid scheduling instances , 2004 .

[9]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[10]  Phil Andrews,et al.  Co-scheduling with User-Settable Reservations , 2005, JSSPP.

[11]  Francine Berman,et al.  New Grid Scheduling and Rescheduling Methods in the GrADS Project , 2004, IPDPS Next Generation Software Program - NSFNGS - PI Workshop.

[12]  Dror G. Feitelson,et al.  Paired Gang Scheduling , 2003, IEEE Trans. Parallel Distributed Syst..

[13]  James Reinders,et al.  Intel® threading building blocks , 2008 .

[14]  Andrei Tchernykh,et al.  Two Level Job-Scheduling Strategies for a Computational Grid , 2005, PPAM.

[15]  Achim Streit,et al.  Enhanced Algorithms for Multi-site Scheduling , 2002, GRID.

[16]  Youngsoo Shin,et al.  Power conscious fixed priority scheduling for hard real-time systems , 1999, Proceedings 1999 Design Automation Conference (Cat. No. 99CH36361).

[17]  Jiadao Li,et al.  Learning-based negotiation strategies for grid scheduling , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[18]  Dimitrios S. Nikolopoulos,et al.  Scheduling algorithms with bus bandwidth considerations for SMPs , 2003, 2003 International Conference on Parallel Processing, 2003. Proceedings..

[19]  John K. Ousterhout.  Scheduling Techniques for Concurrebt Systems. , 1982, ICDCS 1982.

[20]  Ian Pratt,et al.  Multiprogramming Performance of the Pentium 4 with Hyper-Threading , 2004 .

[21]  Yoav Etsion,et al.  Hardware Parallelism : Are Operating Systems Ready ? ( Case Studies in Mis-Scheduling ) , 2006 .

[22]  Carsten Franke,et al.  On Advantages of Scheduling Using Genetic Fuzzy Systems , 2006, JSSPP.

[23]  Shilpa Lawande,et al.  Grid Revolution: An Introduction to Enterprise Grid Computing , 2005 .

[24]  Rajkumar Buyya,et al.  A grid service broker for scheduling distributed data-oriented applications on global grids , 2004, MGC '04.

[25]  Dan Tsafrir,et al.  Desktop scheduling: how can we know what the user wants? , 2004, NOSSDAV '04.

[26]  Rizos Sakellariou,et al.  Towards Service Level Agreement Based Scheduling on the Grid , 2004 .

[27]  Samuel Williams,et al.  The potential of the cell processor for scientific computing , 2005, CF '06.

[28]  T.G. Robertazzi,et al.  Multi-Source Grid Scheduling for Divisible Loads , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[29]  Uwe Schwiegelshohn,et al.  Parallel Job Scheduling - A Status Report , 2004, JSSPP.

[30]  Gábor Terstyánszky,et al.  Service-Oriented Production Grids and User Support , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[31]  Eduardo Huedo,et al.  Evaluating the reliability of computational grids from the end user's point of view , 2006, J. Syst. Archit..

[32]  Edward A. Lee,et al.  Implementing BPEL4WS: the architecture of a BPEL4WS implementation: Research Articles , 2006 .

[33]  Steven Hotovy,et al.  Workload Evolution on the Cornell Theory Center IBM SP2 , 1996, JSSPP.

[34]  Dror G. Feitelson,et al.  Pitfalls in Parallel Job Scheduling Evaluation , 2005, JSSPP.

[35]  John K. Ousterhout,et al.  Scheduling Techniques for Concurrent Systems , 1982, ICDCS.

[36]  Xiao Qin,et al.  Enhancing Security of Real-Time Applications on Grids Through Dynamic Scheduling , 2005, JSSPP.

[37]  Uwe Schwiegelshohn,et al.  Fairness in parallel job scheduling , 2000 .

[38]  Geoffrey Fox,et al.  Special Issue: Workflow in Grid Systems , 2006, Concurr. Comput. Pract. Exp..

[39]  L. Benini,et al.  Low-power task scheduling for multiple devices , 2000, Proceedings of the Eighth International Workshop on Hardware/Software Codesign. CODES 2000 (IEEE Cat. No.00TH8518).

[40]  Emmanuel Medernach,et al.  Workload Analysis of a Cluster in a Grid Environment , 2005, JSSPP.

[41]  Dror G. Feitelson,et al.  Flexible coscheduling: mitigating load imbalance and improving utilization of heterogeneous resources , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[42]  J. Duane Northcutt,et al.  SVR4UNIX Scheduler Unacceptable for Multimedia Applications , 1993, NOSSDAV.

[43]  Dean M. Tullsen,et al.  Symbiotic jobscheduling for a simultaneous mutlithreading processor , 2000, SIGP.

[44]  Krisztián Flautner,et al.  Thread-level parallelism and interactive performance of desktop applications , 2000, SIGP.

[45]  Ruonan Rao,et al.  A Multiobjective Resources Scheduling Approach Based on Genetic Algorithms in Grid Environment , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing Workshops.

[46]  Larry Rudolph,et al.  Gang Scheduling Performance Benefits for Fine-Grain Synchronization , 1992, J. Parallel Distributed Comput..

[47]  Ramin Yahyapour,et al.  Scaling of Workload Traces , 2003, JSSPP.

[48]  Angela C. Sodan,et al.  LOMARC - Lookahead Matchmaking for Multi-resource Coscheduling , 2004, JSSPP.

[49]  M. Siddiqui,et al.  Grid Capacity Planning with Negotiation-based Advance Reservation for Optimized QoS , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[50]  Virginia Mary Lo,et al.  Wave Scheduler: Scheduling for Faster Turnaround Time in Peer-Based Desktop Grid Systems , 2005, JSSPP.

[51]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[52]  Ramin Yahyapour,et al.  Applying economic scheduling methods to Grid environments , 2004 .

[53]  Rosario M. Piro,et al.  An economy-based accounting infrastructure for the datagrid , 2003, Proceedings. First Latin American Web Congress.

[54]  Bernd Mohr,et al.  Automatic Trace-Based Performance Analysis of Metacomputing Applications , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[55]  Eitan Frachtenberg.  Process scheduling for the parallel desktop , 2005, 8th International Symposium on Parallel Architectures,Algorithms and Networks (ISPAN'05).

[56]  H. Peter Hofstee,et al.  Power efficient processor architecture and the cell processor , 2005, 11th International Symposium on High-Performance Computer Architecture.

[57]  Rizos Sakellariou,et al.  Euro-Par 2001 Parallel Processing , 2001, Lecture Notes in Computer Science.

[58]  P. Sadayappan,et al.  Unfairness Metrics for Space-Sharing Parallel Job Schedulers , 2005, JSSPP.

[59]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[60]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[61]  Dror G. Feitelson,et al.  Adaptive parallel job scheduling with flexible coscheduling , 2005, IEEE Transactions on Parallel and Distributed Systems.

[62]  M TullsenDean,et al.  Symbiotic jobscheduling for a simultaneous mutlithreading processor , 2000 .

[63]  Scott A. Brandt,et al.  BEST scheduler for integrated processing of best-effort and soft real-time processes , 2001, IS&T/SPIE Electronic Imaging.

[64]  Dror G. Feitelson,et al.  Metrics for Parallel Job Scheduling and Their Convergence , 2001, JSSPP.