ROOT I/O: The Fast and Furious
暂无分享,去创建一个
The increases of data size and in the geographical distribution of analysis intensify the demand on the I/O subsystem. Over the last year, we greatly improved the I/O throughput, in some case by several factors, when reading ROOT files. ROOT'S improved techniques include improving the pre-existing prefetching, the automatic flushing of data buffers at regular intervals and streaming objects member-wise. These advances reduce the number of transactions with the local disk or the network. We worked in close collaboration with the Large Hadron Collider (LHC) experiments to optimize the I/O access to their use cases and to help adapt their framework to take full advantage of these advances. This presentation will describe in details these improvements and how users can benefit from them.
[1] Lorenzo Moneta,et al. ROOT - A C++ framework for petabyte data storage, statistical analysis and visualization , 2009, Comput. Phys. Commun..
[2] G Eulisse,et al. IgProf profiling tool , 2005 .
[3] Josef Weidendorfer,et al. A Tool Suite for Simulation Based Analysis of Memory Access Behavior , 2004, International Conference on Computational Science.