Data management in HEP: An approach

Abstract.In this work we describe an approach to data access and data management in High Energy Physics (HEP), which privileges performance, simplicity and scalability, in storage systems that co-operate. We also show why the typical HEP workload is well positioned to access geographically distributed data repositories and then weigh the advantages and disadvantages of accessing data across the Wide Area Network. We discuss some points related to the architecture that a data access/management system should have in order to exploit these possibilities. Currently, this kind of methods were explored by using the xrootd/Scalla software suite, that is a workable example of a distributed non-transactional data repository for the HEP environment. The Scalla architecture naturally allows us to build globally federated repositories congruent with diverse HEP collaborations and their data access needs. These methodologies, however, are based on the concept of caching associated to a performant messaging system and to an efficient way of accessing data through Wide Area Network, thus they can be applied to other data access systems as well.

[1]  Jesús Carretero,et al.  A parallel and fault tolerant file system based on NFS servers , 2003, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings..

[2]  Iosif Legrand,et al.  Models Of Networked Analysis At Regional Centres For Lhc Experiments (monarc), Phase 2 Report, 24th March 2000 , 2000 .

[3]  Joseph Naor,et al.  On-Line Load Balancing in a Hierarchical Server Topology , 2002, SIAM J. Comput..

[4]  Bruce M. Maggs,et al.  Globally Distributed Content Delivery , 2002, IEEE Internet Comput..

[5]  Jeanna Neefe Matthews,et al.  Serverless network file systems , 1996, TOCS.

[6]  Howard Gobioff,et al.  The Google file system , 2003, SOSP '03.

[7]  Mahadev Satyanarayanan,et al.  Scale and performance in a distributed file system , 1988, TOCS.

[8]  Andrew Hanushevsky,et al.  Data Access Performance Through Parallelization and Vectored Access: Some Results , 2008 .

[9]  Andrew Hanushevsky,et al.  XROOTD/TXNetFile: a highly scalable architecture for data access in the ROOT environment , 2005, ICT 2005.

[10]  Andrew Hanushevsky,et al.  Managing commitments in a multi agent system using passive bids , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[11]  Andreas J. Peters,et al.  Authorization of data access in distributed storage systems , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[12]  Steve R. Waterhouse,et al.  Distributed Search in P2P Networks , 2002, IEEE Internet Comput..

[13]  Jim Zelenka,et al.  Informed prefetching and caching , 1995, SOSP.