The Grid Observatory

The goal of the Grid Observatory project (GO) is to contribute to an experimental theory of large grid systems by integrating the collection of data on the behaviour of the flagship European Grid Infrastructure (EGI) and its users, the development of models, and an ontology for the domain knowledge. The GO gives access to a database of grid usage traces available to the wider computer science community without the need of grid credentials. The paper presents the architecture of the digital curation process enacted by the GO and examples of their exploitation.

[1]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[2]  Valeria V. Krzhizhanovskaya,et al.  Dynamic workload balancing of parallel applications with user-level scheduling on the Grid , 2009, Future Gener. Comput. Syst..

[3]  Marios D. Dikaiakos,et al.  Grid benchmarking: vision, challenges, and current status , 2007, Concurr. Comput. Pract. Exp..

[4]  Manish Parashar,et al.  Energy-efficient application-aware online provisioning for virtualized clouds and data centers , 2010, International Conference on Green Computing.

[5]  Karl Rihaczek,et al.  1. WHAT IS DATA MINING? , 2019, Data Mining for the Social Sciences.

[6]  Shantenu Jha,et al.  SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[7]  Ian Stokes-Rees,et al.  DIRAC: a scalable lightweight architecture for high throughput computing , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[8]  Laurence Field,et al.  An investigation into the mutability of information in production Grid information systems , 2010 .

[9]  Marios D. Dikaiakos,et al.  A Core Grid Ontology for the Semantic Grid , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[10]  A. S. McGough,et al.  Real Time Monitor of Grid job executions , 2010 .

[11]  Mark Crovella,et al.  Locality in a web of streams , 2005, CACM.

[12]  Zdenek Sustr,et al.  A uniform job monitoring service in multiple job universes , 2007, GMW '07.

[13]  Richard Wolski,et al.  Predicting bounds on queuing delay for batch-scheduled parallel machines , 2006, PPoPP '06.

[14]  Michèle Sebag,et al.  Discovering Piecewise Linear Models of Grid Workload , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[15]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..

[16]  Michèle Sebag,et al.  Toward autonomic grids: analyzing the job flow with affinity streaming , 2009, KDD.

[17]  Marios D. Dikaiakos.  Grid benchmarking: vision, challenges, and current status: Research Articles , 2007 .

[18]  A. D. Meglio,et al.  Programming the Grid with gLite , 2006 .

[19]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[20]  Greg Janée.  Digital Curation , 2009, Encyclopedia of Database Systems.

[21]  Jacek Kitowski,et al.  Grid organizational memory - provision of a high-level Grid abstraction layer supported by ontology alignment , 2007, Future Gener. Comput. Syst..

[22]  Alexandru Iosup,et al.  The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[23]  Fabrizio Gagliardi,et al.  Building an infrastructure for scientific Grid computing: status and goals of the EGEE project , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[24]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[25]  Rajarshi Das,et al.  On the use of hybrid reinforcement learning for autonomic resource allocation , 2007, Cluster Computing.

[26]  Balázs Kégl,et al.  Multi-objective Reinforcement Learning for Responsive Grids , 2010, Journal of Grid Computing.