Storage and Analysis Infrastructure for Data Acquisition Systems with High Data Rates

The purpose of process data processing is the analysis of process data. These data are normally measured using a data acquisition system. Several projects use distributed systems, making the controlling from a central instance with secure access to the infrastructure necessary. Special for several projects are also very high resource demands, e.g. the produced data rates. In order to fulfill the requirements of such projects the development of a data acquisition system is necessary. The main requirements are the secure access to the infrastructure, handling of high data rates and the ad hoc analysis of the measured data. In order to make the system scalable and reliable it should be based on open standards. This chapter evaluates already existing remote control software packages and data management systems for the development of distributed data acquisition systems to fulfill the requirements of process data processing projects. The evaluation identifies that the usage of Grid technologies provides the necessary features as the Grid offers, e.g., Grid security and access to storage and computation infrastructure. The provided architecture uses the GRIDCC framework for controlling the detectors, the communication with data management systems to handle the amount of measured data and the communication with Service Oriented Architectures for ad hoc analysis.