Characterizing the I/O behavior of scientific applications on the Cray XT

Scientific applications use input/output (I/O) for obtaining initial conditions and execution parameters, as a persistent way of saving program output, and for safeguarding against system unreliability. Although system sizes are expected to continue increasing, I/O performance is not expected to keep pace with system computation and communication performance. Understanding application I/O demands and system I/O capabilities is the first step toward bridging this gap between them. In this paper, we present our approach for characterizing the I/O demands of applications on the Cray XT. We also present preliminary case studies showing the use of our I/O characterization infrastructure with climate studies and combustion simulation programs.

[1]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[2]  B. Miller,et al.  The Paradyn Parallel Performance Measurement Tools , 1995 .

[3]  Barton P. Miller,et al.  The Paradyn Parallel Performance Measurement Tool , 1995, Computer.

[4]  Daniel A. Reed,et al.  SvPablo: A multi-language architecture-independent performance analysis system , 1999, Proceedings of the 1999 International Conference on Parallel Processing.

[5]  H. Im,et al.  Stretch effects on the burning velocity of turbulent premixed hydrogen/air flames , 2000 .

[6]  Statistical scalability analysis of communication operations in distributed applications , 2001, PPOPP.

[7]  Jeffrey S. Vetter,et al.  Statistical scalability analysis of communication operations in distributed applications , 2001, PPoPP '01.

[8]  K. Taylor,et al.  The Community Climate System Model , 2001 .

[9]  B.P. Miller,et al.  MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[10]  Suzanne M. Kelly,et al.  Software Architecture of the Light Weight Kernel, Catamount , 2005 .

[11]  John M. Levesque,et al.  Practical performance portability in the Parallel Ocean Program (POP) , 2005, Concurr. Pract. Exp..

[12]  O. E. Bronson Messer,et al.  An Evaluation of the ORNL Cray XT 3 , 2006 .

[13]  Allen D. Malony,et al.  The Tau Parallel Performance System , 2006, Int. J. High Perform. Comput. Appl..

[14]  Bernd Mohr,et al.  Automatic Trace-Based Performance Analysis of Metacomputing Applications , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[15]  Toni Cortes,et al.  PARAVER: A Tool to Visualize and Analyze Parallel Code , 2007 .

[16]  Sadaf R. Alam,et al.  An Evaluation of the Oak Ridge National Laboratory Cray XT3 , 2008, Int. J. High Perform. Comput. Appl..