Novel Techniques and Methods for Performance Measurement, Analysis and Monitoring of Cluster and Grid Applications

ABSTRACT The evolution of parallel and distributed architectures and program-ming paradigms for performance-oriented program development challengesthe state of technology for performance tools. Coupling di erent program-ming paradigms such as message passing and shared memory programmingfor hybrid cluster computing (e.g. SMP clusters) is one example for highdemands on performance analysis tools that are capable to cope with applica-tions for multiple programming models and target architectures. Performancetools must be able to observe performance problems at all levels of a systemwhile relating low-level behavior to the application program.This dissertation presents a set of novel techniques and methods for per-formance instrumentation, measurement, monitoring and analysis of clusterand Grid applications. We introduce a classi cation of temporal overheadsforparallel programs that can be used to explain sources of performance prob-lems. A highly customizable instrumentation and measurement system allowsto control the instrumentation and performance measurement for code re-gions and performance metrics of interest in a exible and automatic way.A data repository is employed in order to store performance data and in-formation about performance experiments which alleviates the association ofperformance information with experiments and the source code. Performanceanalysis can be conducted for single and multiple experiment(s).To overcome the limitation of existing performance analysis techniques,which are based on the hard computing model, we propose a novel approachto performance analysis for parallel and distributed systems that is based onsoft computing. Firstly, we introduce the concept of performance score rep-resenting the performance of code regions that is based on fuzzy logic. Wethen propose techniques for classifying the performance according to fuzzyterms representing performance characteristics. A high-level query languageis introduced to support the search for performance problems by using lin-guistic expressions. We present fuzzy-based ranking analysis and bottlenecksearch. Secondly, we propose methods for measuring performance similarityamong code regions and among experiments. We introduce the performancesimilarity analysis that can be employed for multiple experiments. Finally, wedevelop and implement a fuzzy C-means clustering for performance analysis,and introduce fuzzy rules that can be utilized to lter irrelevant performancedata. We propose the soft performance analysis approach in order to sup-port making soft decisions on evaluation, classi cation, search and analysis ofthe performance of parallel and distributed programs, rather than only harddecisions as in most existing performance tools.Thisdissertationintroducesauni edmonitoringandperformanceanalysissystem for the Grid. The uni ed system integrates performance monitoring,dynamic instrumentation of Grid applications, and performance analysis of

[1]  Thomas Fahringer,et al.  Automatic Search for Performance Problems in Parallel and Distributed Programs by Using Multi-experiment Analysis , 2002, HiPC.

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  Rohit Chandra,et al.  Parallel programming in openMP , 2000 .

[4]  Werner Nutt,et al.  R-GMA: An Information Integration System for Grid Monitoring , 2003, OTM.

[5]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[6]  Bernd Mohr,et al.  Automatic performance analysis of hybrid MPI/OpenMP applications , 2003, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings..

[7]  Jeffrey S. Vetter,et al.  A Dynamic Tracing Mechanism for Performance Analysis of OpenMP Applications , 2001, WOMPAT.

[8]  Thomas Fahringer,et al.  Aksum: a performance analysis tool for parallel and distributed applications , 2004 .

[9]  Rolf Hempel,et al.  The MPI Standard for Message Passing , 1994, HPCN.

[10]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[11]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[12]  Marian Bubak,et al.  The CrossGrid Performance Analysis Tool for Interactive Grid Applications , 2002, PVM/MPI.

[13]  Yixin Diao,et al.  ABLE: A toolkit for building multiagent autonomic systems , 2002, IBM Syst. J..

[14]  Olof Barring.  Towards automation of computing fabrics using tools from the fabric management workpackage of the EU DataGrid project , 2003 .

[15]  Martin Schulz,et al.  Performance analysis for teraflop computers: a distributed automatic approach , 2002, Proceedings 10th Euromicro Workshop on Parallel, Distributed and Network-based Processing.

[16]  Xin Li,et al.  Prophesy: an infrastructure for analyzing and modeling the performance of parallel and distributed applications , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[17]  Péter Kacsuk,et al.  Design and implementation of a distributed monitor for semi-on-line monitoring of VisualMP applications , 2000 .

[18]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[19]  Graham D. Riley,et al.  FINESSE: a prototype feedback-guided performance enhancement system , 2000, Proceedings 8th Euromicro Workshop on Parallel and Distributed Processing.

[20]  Michael Franz,et al.  Computing the Similarity of Proling Data Heuristics for Guiding Adaptive Compilation , 1998 .

[21]  Munindar P. Singh,et al.  Service-Oriented Computing: Key Concepts and Principles , 2005, IEEE Internet Comput..

[22]  James R. Larus,et al.  Exploiting hardware performance counters with flow and context sensitive profiling , 1997, PLDI '97.

[23]  Craig Fellenstein,et al.  Evolution of grid computing architecture and grid adoption models , 2004, IBM Syst. J..

[24]  Domenico Talia,et al.  Web Services for Peer-to-Peer Resource Discovery on the Grid , 2004, DELOS.

[25]  Lars Lundberg,et al.  Performance of SOAP in Web Service environment compared to CORBA , 2002, Ninth Asia-Pacific Software Engineering Conference, 2002..

[26]  Ian T. Foster,et al.  The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets , 2000, J. Netw. Comput. Appl..

[27]  Nicholas R. Jennings,et al.  The Semantic Grid: A Future e‐Science Infrastructure , 2003 .

[28]  Hong Linh Truong,et al.  On Utilizing Experiment Data Repository for Performance Analysis of Parallel Applications , 2003, Euro-Par.

[29]  Hung T. Nguyen,et al.  A First Course in Fuzzy Logic , 1996 .

[30]  Siegfried Benkner.  HPF+: High Performance Fortran for advanced scientific and engineering applications , 1999, Future Gener. Comput. Syst..

[31]  Adam Arbree,et al.  Mapping Abstract Complex Workflows onto Grid Environments , 2003, Journal of Grid Computing.

[32]  Bret R. Olszewski,et al.  The performance and performance methodology for a PowerPC SMP system , 1995, Digest of Papers. COMPCON'95. Technologies for the Information Superhighway.

[33]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[34]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[35]  E. Dockner,et al.  Pricing Constant Maturity Floaters with Embedded Options Using Monte Carlo Simulation , 1999 .

[36]  Anoop Gupta,et al.  Parallel computer architecture - a hardware / software approach , 1998 .

[37]  Mariacarla Calzarossa,et al.  A methodology towards automatic performance analysis of parallel applications , 2004, Parallel Comput..

[38]  Barton P. Miller,et al.  Improving Online Performance Diagnosis by the Use of Historical Performance Data , 1999, SC.

[39]  Ian T. Foster,et al.  Security for Grid services , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[40]  Leo Obrst,et al.  The Semantic Web: A Guide to the Future of XML, Web Services and Knowledge Management , 2003 .

[41]  Jason Lee,et al.  NetLogger: a toolkit for distributed system performance analysis , 2000, Proceedings 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (Cat. No.PR00728).

[42]  Alec Wolman,et al.  Instrumentation and optimization of Win32/intel executables using Etch , 1997 .

[43]  Allen D. Malony,et al.  The role of instrumentation and mapping in performance measurement , 2001 .

[44]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[45]  Toni Cortes,et al.  PARAVER: A Tool to Visualize and Analyze Parallel Code , 2007 .

[46]  Hong Linh Truong,et al.  Online Performance Monitoring and Analysis of Grid Scientific Workflows , 2005, EGC.

[47]  Patrick Bosc,et al.  Fuzzy queries and relational databases , 1994, SAC '94.

[48]  J. O. Nicholson.  The RISC system/6000 SMP system , 1995, Digest of Papers. COMPCON'95. Technologies for the Information Superhighway.

[49]  Jeffrey S. Vetter,et al.  Scalable Analysis Techniques for Microprocessor Performance Counter Metrics , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[50]  David A. Wood,et al.  Cache profiling and the SPEC benchmarks: a case study , 1994, Computer.

[51]  Jeffrey K. Hollingsworth,et al.  The dynamic probe class library-an infrastructure for developing instrumentation for performance tools , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[52]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[53]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[54]  Ruth A. Aydt,et al.  A Grid Monitoring Architecture , 2002 .

[55]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[56]  Simon J. Cox,et al.  Towards the Semantic Grid: Putting Knowledge to Work in Design Optimisation , 2003, J. Univers. Comput. Sci..

[57]  Ian Foster,et al.  Designing and building parallel programs , 1994 .

[58]  Dileep Bhandarkar,et al.  VAX vector architecture , 1990, ISCA '90.

[59]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[60]  Stefan Decker,et al.  Ontology-Based Resource Matching in the Grid - The Grid Meets the Semantic Web , 2003, SEMWEB.

[61]  Junseok Hwang,et al.  Middleware services for P2P computing in wireless grid networks , 2004, IEEE Internet Computing.

[62]  Dan Nagle,et al.  MPI -- The Complete Reference, Vol. 1, The MPI Core, 2nd ed., Scientific and Engineering Computation Series, by Marc Snir, Steve Otto, Steven Huss-Lederman, David Walker and Jack Dongarra , 2005 .

[63]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[64]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[65]  Nayda G. Santiago,et al.  A statistical approach for the analysis of the relation between low-level performance information, the code, and the environment , 2002, Proceedings. International Conference on Parallel Processing Workshop.

[66]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[67]  Barton P. Miller,et al.  A Callgraph-Based Search Strategy for Automated Performance Diagnosis (Distinguished Paper) , 2000, Euro-Par.

[68]  Kwang-Hoon Kim,et al.  Performance Analytic Models and Analyses for Workflow Architectures , 2001, Inf. Syst. Frontiers.

[69]  Ii Robert J. Marks.  Fuzzy Logic Technology and Applications I , 1994 .

[70]  Deborah L. McGuinness,et al.  An Environment for Merging and Testing Large Ontologies , 2000, KR.

[71]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[72]  Rajkumar Buyya,et al.  Weaving computational grids: how analogous are they with electrical grids? , 2002, Comput. Sci. Eng..

[73]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[74]  Jerry C. Yan.  Performance Tuning with AIMS - An Automated Instrumentation and Monitoring System for Multicomputers , 1994, HICSS.

[75]  Domenico Talia,et al.  Toward a Synergy Between P2P and Grids , 2003, IEEE Internet Comput..

[76]  Siegfried Benkner,et al.  High-level data mapping for clusters of SMPs , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[77]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[78]  Patrick Valduriez,et al.  Principles of Distributed Database Systems , 1990 .

[79]  Thomas Fahringer,et al.  SCALEA-G: A unified monitoring and performance analysis system for the grid , 2004 .

[80]  Susan L. Graham,et al.  Gprof: A call graph execution profiler , 1982, SIGPLAN '82.

[81]  Hong Linh Truong,et al.  On Using SCALEA for Performance Analysis of Distributed and Parallel Programs , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[82]  Thomas Fahringer,et al.  Teuta: Tool Support for Performance Modeling of Distributed and Parallel Applications , 2004, International Conference on Computational Science.

[83]  Asunción Gómez-Pérez,et al.  Ontology Specification Languages for the Semantic Web , 2002, IEEE Intell. Syst..

[84]  Gregor von Laszewski,et al.  A Java commodity grid kit , 2001, Concurr. Comput. Pract. Exp..

[85]  Thomas J. LeBlanc,et al.  Parallel performance prediction using lost cycles analysis , 1994, Proceedings of Supercomputing '94.

[86]  Rudolf Eigenmann,et al.  Where Does the Speedup Go: Quantitative Modeling of Performance Losses in Shared-Memory Programs , 2000, Parallel Process. Lett..

[87]  Brian Tierney,et al.  A Monitoring Sensor Management System for Grid Environments , 2004, Cluster Computing.

[88]  Hong Linh Truong,et al.  SCALEA-G: A Unified Monitoring and Performance Analysis System for the Grid , 2004, European Across Grids Conference.

[89]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[90]  Marian Bubak,et al.  Performance Tools for the Grid: State of the Art and Future , 2004 .

[91]  J. Mark Bull,et al.  A hierarchical classification of overheads in parallel programs , 1996, Software Engineering for Parallel and Distributed Systems.

[92]  Christoforos Kozyrakis,et al.  A Media-Enhanced Vector Architecture for Embedded Memory Systems , 1999 .

[93]  Steven Tuecke,et al.  The Physiology of the Grid An Open Grid Services Architecture for Distributed Systems Integration , 2002 .

[94]  Bernd Mohr,et al.  Towards a Performance Tool Interface for OpenMP: An Approach based on Directive Rewriting , 2001 .

[95]  John F. Sowa,et al.  Knowledge representation: logical, philosophical, and computational foundations , 2000 .

[96]  Hong Linh Truong,et al.  Self-managing sensor-based middleware for performance monitoring and data integration in grids , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[97]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[98]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[99]  Víctor A. Villagrá,et al.  Ontologies: giving semantics to network management models , 2003 .

[100]  Ian T. Foster,et al.  A security architecture for computational grids , 1998, CCS '98.

[101]  Hong Linh Truong,et al.  Performance Analysis for MPI Applications with SCALEA , 2002, PVM/MPI.

[102]  Hong Linh Truong,et al.  Performance Analysis, Data Sharing, and Tools Integration in Grids: New Approach Based on Ontology , 2004, International Conference on Computational Science.

[103]  Siegfried Benkner.  VFC: The Vienna Fortran Compiler , 1999, Sci. Program..

[104]  Radu Prodan,et al.  ASKALON: a tool set for cluster and Grid computing , 2005, Concurr. Pract. Exp..

[105]  Hong Linh Truong,et al.  SCALEA: a performance analysis tool for parallel programs , 2003, Concurr. Comput. Pract. Exp..

[106]  Dieter Fensel,et al.  Ontologies: A silver bullet for knowledge management and electronic commerce , 2002 .

[107]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[108]  Allen D. Malony,et al.  Performance Technology for Complex Parallel and Distributed Systems , 2001 .

[109]  D. S. Henty,et al.  Performance of Hybrid Message-Passing and Shared-Memory Parallelism for Discrete Element Modeling , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[110]  Ian T. Foster,et al.  Data management and transfer in high-performance computational grid environments , 2002, Parallel Comput..

[111]  Ulrich Detert.  Vector Processing on CRAY-1 and CRAY X-MP , 1985 .

[112]  D.A. Reed,et al.  Scalable performance analysis: the Pablo performance analysis environment , 1993, Proceedings of Scalable Parallel Libraries Conference.

[113]  Péter Kacsuk,et al.  From Cluster Monitoring to Grid Monitoring Based on GRM , 2001, Euro-Par.

[114]  Robert B. Ross,et al.  Using MPI-2: Advanced Features of the Message Passing Interface , 2003, CLUSTER.

[115]  Hong Linh Truong,et al.  Soft Computing Approach to Performance Analysis of Parallel and Distributed Programs , 2005, Euro-Par.

[116]  Nacho Navarro,et al.  DITools: Application-level Support for Dynamic Extension and Flexible Composition , 2000, USENIX Annual Technical Conference, General Track.

[117]  Michael J. Flynn,et al.  Some Computer Organizations and Their Effectiveness , 1972, IEEE Transactions on Computers.

[118]  Yves Lecourtier,et al.  Source-to-Source Instrumentation for the Optimization of an Automatic Reading System , 2004, The Journal of Supercomputing.

[119]  Jerry L. Potter.  The Massively Parallel Processor , 1985 .

[120]  Nicola Mazzocca,et al.  Performance modeling of scientific applications: scalability analysis of LAPW0 , 2003, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings..

[121]  Przemyslaw Stpiczynski,et al.  Book Review: Parallel Programming in OpenMP Helps Novices (A review of Parallel Programming in OpenMP by Rohit Chandra, Leonardo Dagum, Dave Kohr, Dror Maydan, Jeff McDonald, and Ramesh Menon) , 2002, IEEE Distributed Syst. Online.

[122]  Ian T. Foster,et al.  Grid Services for Distributed System Integration , 2002, Computer.

[123]  Mladen A. Vouk,et al.  Quality of service and scientific workflows , 1996, Quality of Numerical Software.

[124]  William E. Johnston,et al.  The NetLogger methodology for high performance distributed systems performance analysis , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[125]  J. C. Yan,et al.  Performance tuning with AIMS/spl minus/an Automated Instrumentation and Monitoring System for multicomputers , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[126]  William Gropp,et al.  Toward Scalable Performance Visualization with Jumpshot , 1999, Int. J. High Perform. Comput. Appl..

[127]  Jack Dongarra,et al.  An algebra for cross-experiment performance analysis , 2004 .

[128]  Thomas Fahringer,et al.  On using Aksum for semi-automatically searching of performance problems in parallel and distributed programs , 2003, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings..

[129]  Domenico Talia,et al.  A Grid Programming Primer , 2001 .

[130]  Antonio Badia,et al.  Ontologies , 2001, Springer Berlin Heidelberg.

[131]  Chris Ding,et al.  MPI and OpenMP Paradigms on Cluster of SMP Architectures: The Vacancy Tracking Algorithm for Multi-Dimensional Array Transposition , 2002 .

[132]  Zoltán Balaton,et al.  Resource and Job Monitoring in the Grid , 2003, Euro-Par.

[133]  Jack J. Dongarra,et al.  A Scalable Cross-Platform Infrastructure for Application Performance Tuning Using Hardware Counters , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[134]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[135]  J. C. Peters,et al.  Fuzzy Cluster Analysis : A New Method to Predict Future Cardiac Events in Patients With Positive Stress Tests , 1998 .

[136]  Hong Linh Truong,et al.  SCALEA: A Performance Analysis Tool for Distributed and Parallel Programs , 2002, Euro-Par.

[137]  Radu Prodan,et al.  ZENTURIO: an experiment management system for cluster and Grid computing , 2002, Proceedings. IEEE International Conference on Cluster Computing.

[138]  B.P. Miller,et al.  Experiment Management Support for Performance Tuning , 1997, ACM/IEEE SC 1997 Conference (SC'97).

[139]  Jean-Yves Girard,et al.  Enabling applications for grid computing with globus , 2003 .

[140]  Andrew A. Chien,et al.  DGMonitor: A Performance Monitoring Tool for Sandbox-Based Desktop Grid Platforms , 2004, IPDPS.

[141]  Insung Park,et al.  Parallel Programming and Performance Evaluation with the URSA Tool Family , 2004, International Journal of Parallel Programming.

[142]  Mark A. Musen,et al.  PROMPT: Algorithm and Tool for Automated Ontology Merging and Alignment , 2000, AAAI/IAAI.

[143]  Schahram Dustdar,et al.  Performance metrics and ontology for describing performance data of grid workflows , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[144]  Schahram Dustdar,et al.  Dynamic Instrumentation, Performance Monitoring and Analysis of Grid Scientific Workflows , 2005, Journal of Grid Computing.

[145]  Jeffrey K. Hollingsworth,et al.  An API for Runtime Code Patching , 2000, Int. J. High Perform. Comput. Appl..

[146]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[147]  Bernd Mohr,et al.  A Tool Framework for Static and Dynamic Analysis of Object-Oriented Software with Templates , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[148]  Richard M. Russell,et al.  The CRAY-1 computer system , 1978, CACM.

[149]  Daniel A. Reed,et al.  Performance Contracts: Predicting and Monitoring Grid Application Behavior , 2001, GRID.

[150]  David A. Bader,et al.  A novel FDTD application featuring OpenMP-MPI hybrid parallelization , 2004 .

[151]  Péter Kacsuk,et al.  P-GRADE: A Grid Programming Environment , 2003, Journal of Grid Computing.

[152]  Ruth A. Aydt,et al.  Scalable Performance Analysis : The Pablo PerformanceAnalysis , 1993 .

[153]  Andrew A. Chien,et al.  DGMonitor: A Performance Monitoring Tool for Sandbox-Based Desktop Grid Platforms , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[154]  Jeffrey S. Vetter,et al.  Autopilot: adaptive control of distributed applications , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[155]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[156]  Péter Kacsuk,et al.  Monitoring Message Passing Applications in the Grid with GRM and R-GMA , 2003, PVM/MPI.

[157]  Thomas Fahringer,et al.  Standardized Intermediate Representation for Fortran, Java, C and C++ Programs , 2004 .

[158]  Earl Cox.  FuzzySQL a tool for finding the truth: the power of approximate database queries , 2000 .

[159]  Ian T. Foster,et al.  On Death, Taxes, and the Convergence of Peer-to-Peer and Grid Computing , 2003, IPTPS.

[160]  Bernd Mohr,et al.  Monitoring and Instrumentation Requests for Fortran, Java, C and C++ Programs , 2000 .

[161]  Lotfi A. Zadeh,et al.  Possibility theory and soft data analysis , 1996 .

[162]  Jennifer Seitzer.  In Search of Clusters. The Ongoing battle in lowly parallel computing , 1999, Scalable Comput. Pract. Exp..

[163]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[164]  Robert J. Fowler,et al.  HPCVIEW: A Tool for Top-down Analysis of Node Performance , 2002, The Journal of Supercomputing.

[165]  Mark Bull,et al.  Development of mixed mode MPI / OpenMP applications , 2001, Sci. Program..

[166]  Franck Cappello,et al.  MPI versus MPI+OpenMP on the IBM SP for the NAS Benchmarks , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[167]  Andrea F. Abate,et al.  Workflow performance evaluation through WPQL , 2002, SEKE '02.

[168]  Heiner Stuckenschmidt,et al.  Ontology-Based Integration of Information - A Survey of Existing Approaches , 2001, OIS@IJCAI.

[169]  Bernd Mohr,et al.  Automatic Performance Analysis of SMP Cluster Applications , 2001 .

[170]  Bartosz Balis,et al.  An Infrastructure for Grid Application Monitoring , 2002, PVM/MPI.

[171]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[172]  Vern Paxson,et al.  Towards a Framework for Defining Internet Performance Metrics , 2006 .

[173]  Jeffrey S. Vetter.  Performance analysis of distributed applications using automatic classification of communication inefficiencies , 2000, ICS '00.

[174]  Allen D. Malony,et al.  A Runtime Monitoring Framework for the TAU Profiling System , 1999, ISCOPE.

[175]  Sanjay Kumar Madria,et al.  Sensor networks: an overview , 2003 .

[176]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[177]  Robert J. Hall,et al.  Call Path Refinement Profiles , 1995, IEEE Trans. Software Eng..

[178]  Barton P. Miller,et al.  The Paradyn Parallel Performance Measurement Tool , 1995, Computer.

[179]  Jaroslav Ramík,et al.  Soft Computing: Overview and Recent Developments in Fuzzy Optimization , 2001 .

[180]  Thomas Fahringer,et al.  UML based modeling of performance oriented parallel and distributed applications , 2002, Proceedings of the Winter Simulation Conference.

[181]  Amit P. Sheth,et al.  Workflow Quality of Service , 2002, ICEIMT.

[182]  Rita Almeida Ribeiro,et al.  Fuzzy query interface for a business database , 2003, Int. J. Hum. Comput. Stud..