AAA: A Massive Data Acquisition Approach in Large-Scale System Monitoring

The rapid development of information system proposes higher demand for monitoring. Usually we resort to a data acquisition system to collect variety of metrics from each device for real-time anomaly detection, alerting and analysis. It is a great challenge to realize real-time and reliable data collection and gathering in a data acquisition system for large-scale system. In this paper, we propose an Adaptive window Acquisition Algorithm (AAA) to support data acquisition on great amount of data sources. AAA can dynamically adjust its policy according to the number of data sources and the acquisition interval to achieve better performance. The algorithm has been applied to a large management system project. Experimental results show that with the help of dynamic adjusting mechanism, the proposed approach can provide reliable collection service for common data acquisition systems.