Architecting the Database Access for a IT Infrastructure and Data Center Monitoring Tool

We present our experience in architecting the database access for a tool that analyzes IT infrastructure and data center utilization. We study solutions built on top of TSDB [2] and SQL Server. We provide a configuration based multi threaded approach in SQL Server based on Spring Batch [1]. Our architecture includes spring batch partitioning, JDBC-R bridge rewrite and optimized Transact-SQL procedures.

[1]  Luiz André Barroso,et al.  Web Search for a Planet: The Google Cluster Architecture , 2003, IEEE Micro.

[2]  Qi Zhao,et al.  Towards automated performance diagnosis in a large IPTV network , 2009, SIGCOMM '09.

[3]  Liu Xiao-ying Fast Subsequence Matching in Time-series Database , 2008 .

[4]  Sangameshwar Patil,et al.  Automated debugging of SLO violations in enterprise systems , 2010, 2010 Second International Conference on COMmunication Systems and NETworks (COMSNETS 2010).

[5]  Prashant J. Shenoy,et al.  Predico: A System for What-if Analysis in Complex Data Center Applications , 2011, Middleware.

[6]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[7]  Eamonn J. Keogh,et al.  Locally adaptive dimensionality reduction for indexing large time series databases , 2001, SIGMOD '01.

[8]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[9]  Christos Faloutsos,et al.  Fast subsequence matching in time-series databases , 1994, SIGMOD '94.

[10]  Richard T. Snodgrass,et al.  Developing Time-Oriented Database Applications in SQL , 1999 .

[11]  Paramvir Bahl,et al.  Towards highly reliable enterprise network services via inference of multi-level dependencies , 2007, SIGCOMM.

[12]  Kyuseok Shim,et al.  Fast Similarity Search in the Presence of Noise, Scaling, and Translation in Time-Series Databases , 1995, VLDB.

[13]  Emmanuel Cecchet,et al.  Performance debugging in data centers: Doing more with less , 2009, 2009 First International Communication Systems and Networks and Workshops.