Performance visualization for parallel programs

SummaryWe describe here a set of graphical performance visualization tools that have been developed at Argonne National Laboratory for increasing one's understanding of the behavior of parallel programs

[1]  Oscar Naim D'Paola Performance visualization of parallel programs , 1995 .

[2]  C. M. Grassl Parallel performance of applications on supercomputers , 1991, Parallel Comput..

[3]  Ian Glendinning,et al.  Generic Visualization and Performance Monitoring Tools for Message Passing Parallel Systems , 1992, Programming Environments for Parallel Computing.

[4]  Richard Taylor,et al.  Maritxu: Generic Visualization of Highly Parallel Processing , 1992, Programming Environments for Parallel Computing.

[5]  Michael D. Rice,et al.  Modeling the Serial and Parallel Fractions of a Parallel Algorithm , 1991, J. Parallel Distributed Comput..

[6]  Milos D. Ercegovac,et al.  A methodology for performance analysis of parallel computations with looping constructs , 1992 .

[7]  Bernd Mohr Standardization of Event Traces Considered Harmful or Is an Implementation of Object-Independent Eve , 1993 .

[8]  Diane T. Rover,et al.  Visual-aural representations of performance for a scalable application program , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[9]  Thomas J. Leblanc,et al.  Analyzing Parallel Program Executions Using Multiple Views , 1990, J. Parallel Distributed Comput..

[10]  Harry F. Jordan,et al.  Multiprogramming and The Performance of Parallel Programs , 1987, PPSC.

[11]  B. Miller,et al.  The Paradyn Parallel Performance Measurement Tools , 1995 .

[12]  Dennis Gannon,et al.  Faust: an environment for programming parallel scientific applications , 1988, Proceedings. SUPERCOMPUTING '88.

[13]  Emilio Luque,et al.  Simulation and visualization tools for link-based parallel architectures , 1991 .

[14]  Alois Ferscha,et al.  A Petri Net Approach for Performance Oriented Parallel Program Design , 1992, J. Parallel Distributed Comput..

[15]  Bernd Mohr,et al.  SIMPLE: A Performance Evaluation Tool Environment for Parallel and Distributed Systems , 1991, EDMCC.

[16]  Jack Dongarra,et al.  Pvm 3 user's guide and reference manual , 1993 .

[17]  Diane T. Rover,et al.  Visualizing the Performance of SPMD and Data-Parallel Programs , 1993, J. Parallel Distributed Comput..

[18]  Ilya Gertner,et al.  Non-intrusive and interactive profiling in parasight , 1988, PPEALS '88.

[19]  Roger W. Hockney,et al.  Performance parameters and benchmarking of supercomputers , 1991, Parallel Comput..

[20]  Oscar Naim,et al.  Environments, Performance Analysis and Data Visualisation , 1994 .

[21]  Alan Wagner,et al.  TIPS: transputer-based interactive parallelizing system , 1991 .

[22]  Jack Worlton,et al.  Toward a taxonomy of performance metrics , 1991, Parallel Comput..

[23]  R. van de Geijn,et al.  A look at scalable dense linear algebra libraries , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[24]  Oscar Naim,et al.  A toolkit for optimising parallel performance , 1995, HPCN Europe.

[25]  Nicholas T. Karonis Timing Parallel Programs that Use Message Passing , 1992, J. Parallel Distributed Comput..

[26]  Rolf Hempel,et al.  The ANL/GMD Macros (PARMACS) in FORTRAN for Portable Parallel Programming using the Message Passing , 1991 .

[27]  Douglas N. Kimelman,et al.  The RP3 program visualization environment , 1991, IBM J. Res. Dev..

[28]  Harry F. Jordan Interpreting parallel processor performance measurements , 1985, PPSC.

[29]  Daniel A. Menascé,et al.  A Methodology for Performance Evaluation of Parallel Applications on Multiprocessors , 1992, J. Parallel Distributed Comput..

[30]  Chris R. Jesshope,et al.  Parallel Computers 2: Architecture, Programming and Algorithms , 1981 .

[31]  Herb Schwetman,et al.  Monit: a performance monitoring tool for parallel and pseudo-parallel programs , 1987, SIGMETRICS '87.

[32]  Larry Rudolph,et al.  PIE: A Programming and Instrumentation Environment for Parallel Processing , 1985, IEEE Software.

[33]  Bernard Tourancheau,et al.  The massively parallel monitoring system: a truly parallel approach to parallel monitoring , 1993 .

[34]  Alan H. Karp,et al.  Measuring parallel processor performance , 1990, CACM.

[35]  Peter Dauphin,et al.  Model-driven Validation of Parallel Programs based on Event Traces , 1992, Programming Environments for Parallel Computing.

[36]  Rebecca Koskela,et al.  Instrumentation for future parallel computing systems , 1989 .

[37]  Kathleen M. Nichols Performance tools , 1990, IEEE Software.

[38]  Barton P. Miller,et al.  Parallel program performance metrics: a comparison and validation , 1992, Proceedings Supercomputing '92.

[39]  Barton P. Miller,et al.  Performance Measurement for Parallel and Distributed Programs: A Structured and Automatic Approach , 1989, IEEE Trans. Software Eng..

[40]  Helmar Burkhart,et al.  Performance-Measurement Tools in a Multiprocessor Environment , 1989, IEEE Trans. Computers.

[41]  Ian Foster,et al.  Strand: New Concepts in Parallel Programming , 1990 .

[42]  Wolfgang Kastner,et al.  Monitoring of distributed real-time systems: the versatile timing analyzer (VTA) , 1993 .

[43]  Eran Gabber,et al.  VMMP: A Practical Tool for the Development of Portable and Efficient Programs for Multiprocessors , 1990, IEEE Trans. Parallel Distributed Syst..

[44]  Alva L. Couch Categories and Context in Scalable Execution Visualization , 1993, J. Parallel Distributed Comput..

[45]  John L. Hennessy,et al.  Mtool: An Integrated System for Performance Debugging Shared Memory Multiprocessor Applications , 1993, IEEE Trans. Parallel Distributed Syst..

[46]  Ewing L. Lusk,et al.  A Graphical Tool for Observing the Behavior of Parallel Logic Programs , 1987, SLP.

[47]  Doug Kimelman,et al.  A methodology for visualizing performance of loosely synchronous programs , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[48]  K. Mani Chandy,et al.  An introduction to parallel programming , 1992 .

[49]  Rolf Hempel,et al.  The MPI Message Passing Interface Standard , 1994 .

[50]  Dieter Haban,et al.  Monitoring and measuring distributed systems , 1990 .

[51]  Daniel A. Reed,et al.  A performance analysis exemplar: Parallel ray tracing , 1992, Concurr. Pract. Exp..

[52]  Allen D. Malony,et al.  Traceview: a trace visualization tool , 1991, IEEE Software.

[53]  Michael T. Heath,et al.  Visualizing the performance of parallel programs , 1991, IEEE Software.

[54]  Reinhold Kröger,et al.  JEWEL: Design and Implementation of a Distributed Measurement System , 1992, IEEE Trans. Parallel Distributed Syst..

[55]  Giuliana Franceschinis,et al.  Understanding Parallel Program Behavior through Petri Net Models , 1992, J. Parallel Distributed Comput..

[56]  Emilio Hernández,et al.  Benchmarks Specification and Generation for Performance Estimation on MIMD Machines , 1994, Applications in Parallel and Distributed Computing.

[57]  Roger W. Hockney A framework for benchmark performance analysis , 1991 .

[58]  Arif Ghafoor,et al.  PAWS: a performance evaluation tool for parallel computing systems , 1991, Computer.

[59]  William G. Griswold,et al.  Experiences with poker , 1988, PPEALS '88.

[60]  Kevin Smith,et al.  Start/Pat: a parallel-programming toolkit , 1989, IEEE Software.

[61]  Rebecca Koskela,et al.  Performance instrumentation and visualization , 1990 .

[62]  Oscar Naim,et al.  Invasiveness of Performance Instrumentation Measurements on Mulitprocessors , 1994, Applications in Parallel and Distributed Computing.

[63]  R.D. McLaren,et al.  Instrumentation and Performance Monitoring of Distributed Systems , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[64]  Umberto Villano Monitoring parallel programs running in Transputer networks , 1993 .

[65]  Matthew H. Redly A performance monitor for parallel programs , 1990 .

[66]  Thomas Bemmerl,et al.  Visualization of Message Passing Parallel Programs with the TOPSYS Parallel Programming Environment , 1993, J. Parallel Distributed Comput..

[67]  Mary Lou Soffa,et al.  A visualization system for parallelizing programs , 1992, Proceedings Supercomputing '92.

[68]  Warren Harrison Tools for multiple-CPU environments , 1990, IEEE Software.

[69]  Dieter Haban,et al.  A Hybrid Monitor for Behavior and Performance Analysis of Distributed Systems , 1990, IEEE Trans. Software Eng..

[70]  Dieter Haban,et al.  Monitoring and Performance Measuring Distributed Systems During Operation , 1988, SIGMETRICS.

[71]  Bernd Mohr Performance Evaluation of Parallel Programs in Parallel and Distributed Systems , 1990, CONPAR.

[72]  H. J. Beier,et al.  Software monitoring of parallel programs , 1989 .

[73]  Reinhold Weicker,et al.  An overview of common benchmarks , 1990, Computer.

[74]  Joan M. Francioni,et al.  The Sounds of Parallel Programs , 1991, The Sixth Distributed Memory Computing Conference, 1991. Proceedings.

[75]  A. Globus,et al.  Fourteen Ways to Say Nothing with Scientific Visualization , 1994, Computer.

[76]  Allen D. Malony,et al.  Performance Measurement Intrusion and Perturbation Analysis , 1992, IEEE Trans. Parallel Distributed Syst..

[77]  Barton P. Miller What to Draw? When to Draw? An Essay on Parallel Program Visualization , 1993, J. Parallel Distributed Comput..

[78]  Michael T. Heath,et al.  Recent developments and case studies in performance visualization using ParaGraph , 1993 .

[79]  Alva L. Couch,et al.  Portable execution traces for parallel program debugging and performance visualization , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[80]  G. A. Geist,et al.  A user's guide to PICL a portable instrumented communication library , 1990 .

[81]  Marc Abrams,et al.  Chitra: Visual Analysis of Parallel and Distributed Programs in the Time, Event, and Frequency Domains , 1992, IEEE Trans. Parallel Distributed Syst..

[82]  Joan M. Francioni,et al.  Debugging parallel programs using sound , 1991, PADD '91.

[83]  Don Allen,et al.  Data Visualization and Performance Analysis in the Prism Programming Environment , 1992, Programming Environments for Parallel Computing.

[84]  Wolfgang E. Nagel,et al.  Benchmarking parallel programs in a multiprogramming environment: the PAR-Bench system , 1991, Parallel Comput..

[85]  Asser N. Tantawi,et al.  Performance analysis of parallel processing systems , 1987, SIGMETRICS '87.

[86]  Robert J. Fowler,et al.  An integrated approach to parallel program debugging and performance analysis onlarge-scale multiprocessors , 1988, PADD '88.

[87]  Performance Visualisation in a Portable Parallel , 1992 .

[88]  Vladimir Getov,et al.  Performance visualisation in a portable parallel programming environment , 1993 .

[89]  James H. Patterson,et al.  Portable Programs for Parallel Processors , 1987 .

[90]  Gregory V. Wilson,et al.  Future directions in parallel performance environments , 1993 .

[91]  Barton P. Miller,et al.  The integration of application and system based metrics in a parallel program performance tool , 1991, PPOPP '91.

[92]  Xian-He Sun,et al.  Toward a better parallel performance metric , 1991, Parallel Comput..

[93]  Michael M. Gorlick,et al.  Timing Prolog Programs without Clock , 1987, International Conference on Spoken Language Processing.

[94]  A. Beguelin Xab: a tool for monitoring PVM programs , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[95]  William Gropp,et al.  Users guide for the ANL IBM SP1 , 1994 .

[96]  John L. Gustafson,et al.  Reevaluating Amdahl's law , 1988, CACM.

[97]  Thomas J. LeBlanc,et al.  Debugging Parallel Programs with Instant Replay , 1987, IEEE Transactions on Computers.

[98]  Ottmar Krämer-Fuhrmann,et al.  A Graphical programming Environment for Parallel Embedded Systems , 1992, Programming Environments for Parallel Computing.

[99]  Roger W. Hockney,et al.  F1/2: a Parameter to Characterize Memory and Communication Bottlenecks , 1989, Parallel Comput..

[100]  Harvey J. Wasserman,et al.  The performance realities of massively parallel processors: a case study , 1992, Proceedings Supercomputing '92.

[101]  Jack J. Dongarra,et al.  Visualization and debugging in a heterogeneous environment , 1993, Computer.

[102]  Rainer Klar,et al.  Event-driven monitoring of parallel systems , 1993 .

[103]  William McCune,et al.  ROO: A Parallel Theorem Prover , 1992, CADE.

[104]  Eero Saarinen IBM Thomas J. Watson Research Center , 1961 .

[105]  C. E. Fineman,et al.  Selective monitoring using performance metric predicates , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[106]  Kayhan Imre Experiences with monitoring and visualising the performance of parallel programs , 1993 .

[107]  Thomas E. Anderson,et al.  Quartz: a tool for tuning parallel program performance , 1990, SIGMETRICS '90.

[108]  Oscar Naim,et al.  Do-Loop-Surface: An Abstract Performance Data Visualization , 1994, HPCN.

[109]  Barton P. Miller,et al.  IPS-2: The Second Generation of a Parallel Program Measurement System , 1990, IEEE Trans. Parallel Distributed Syst..

[110]  Alva L. Couch,et al.  Monitoring ParalIel Executions in Real Time , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[111]  Ewing Lusk,et al.  Studying parallel program behavior with upshot , 1991 .

[112]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[113]  Bernd Mohr,et al.  Distributed Performance Monitoring: Methods, Tools, and Applications , 1994, IEEE Trans. Parallel Distributed Syst..

[114]  Gurpur M. Prabhu,et al.  Visualization of Program Performance on Concurrent Computers , 1989, Great Lakes Computer Science Conference.