Information systems playground—the target infrastructure

The Target infrastructure has been specially built as a storage and compute infrastructure for the information systems derived from Astro-WISE. This infrastructure will be used by several applications that collaborate in the area of information systems within the Target project. It currently consists of 10 PB of storage and thousands of computational cores. The infrastructure has been constructed based on the requirements of the applications. The storage is controlled by the Global Parallel File System of IBM. This file system takes care of the required flexibility by combining storage hardware with different characteristics into a single file system. It is also very scalable, which allows the system to be extended into the future, while replacing old hardware with new technology.

[1]  K. G. Begeman,et al.  LOFAR Information System , 2011, Future generations computer systems.

[2]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[3]  Lambert Schomaker,et al.  Handwritten-Word Spotting Using Biologically Inspired Features , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  A.W. Gunst,et al.  Signal Processing Aspects of the Low Frequency Array , 2007, 2007 IEEE International Conference on Signal Processing and Communications.

[5]  Edwin Valentijn,et al.  Astro-WISE: Tracing and Using Lineage for Scientific Data Processing , 2009, 2009 International Conference on Network-Based Information Systems.

[6]  G. Bruce Berriman,et al.  The Application of Cloud Computing to Astronomy: A Study of Cost and Performance , 2010, 2010 Sixth IEEE International Conference on e-Science Workshops.

[7]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[8]  Paul T. Groth,et al.  The application of cloud computing to the creation of image mosaics and management of their provenance , 2010, Astronomical Telescopes + Instrumentation.

[9]  Ronald Nijboer,et al.  The LOFAR Telescope: System Architecture and Signal Processing , 2009, Proceedings of the IEEE.

[10]  Magdalena Balazinska,et al.  Astronomical Image Processing with Hadoop , 2011 .

[11]  Lambert Schomaker,et al.  Where are the Search Engines for Handwritten Documents? , 2009 .

[12]  Edwin A. Valentijn,et al.  Lofar information system design , 2009 .

[13]  Gavin McCance,et al.  Storage and Data Management in EGEE , 2007, ACSW.

[14]  Lambert Schomaker.  Word mining in a sparsely labeled handwritten collection , 2008, Electronic Imaging.

[15]  Prashant Pandey,et al.  Cloud Analytics: Do We Really Need to Reinvent the Storage Stack? , 2009, HotCloud.

[16]  Frank B. Schmuck,et al.  GPFS: A Shared-Disk File System for Large Computing Clusters , 2002, FAST.

[17]  Howard Gobioff,et al.  The Google file system , 2003, SOSP '03.

[18]  Andrey N. Belikov,et al.  Merging Grid Technologies , 2010, Journal of Grid Computing.