Unified logging system for monitoring multiple cloud storage providers in cloud storage broker

With the increasing demand for personal and enterprise data storage service, Cloud Storage Broker (CSB) provides cloud storage service using multiple Cloud Service Providers (CSPs) with guaranteed Quality of Service (QoS), such as data availability and security. However monitoring cloud storage usage in multiple CSPs has become a challenge for CSB due to lack of standardized logging format for cloud services that causes each CSP to implement its own format. In this paper we propose a unified logging system that can be used by CSB to monitor cloud storage usage across multiple CSPs. We gather cloud storage log files from three different CSPs and normalise these into our proposed log format that can be used for further analysis process. We show that our work enables a coherent view suitable for data navigation, monitoring, and analytics.

[1]  Donal Casey.  Log Management: Turning log files into a security asset , 2008 .

[2]  Esmiralda Moradian,et al.  Secure Audit Log Management , 2013, KES.

[3]  Fatos Xhafa,et al.  Using Grid services to parallelize IBM's Generic Log Adapter , 2011, J. Syst. Softw..

[4]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[5]  Raffael Marty,et al.  Cloud application logging for forensics , 2011, SAC.

[6]  Christoph Meinel,et al.  Implementation of a secure and reliable storage above the untrusted clouds , 2013, 2013 8th International Conference on Computer Science & Education.

[7]  Christoph Meinel,et al.  Hierarchical object log format for normalisation of security events , 2013, 2013 9th International Conference on Information Assurance and Security (IAS).

[8]  Sushil Jajodia,et al.  Threat Modeling for Cloud Data Center Infrastructures , 2016, FPS.

[9]  Hakim Weatherspoon,et al.  RACS: a case for cloud storage diversity , 2010, SoCC '10.

[10]  Bu-Sung Lee,et al.  How to Track Your Data: The Case for Cloud Computing Provenance , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[11]  Omer F. Rana,et al.  STACEE: enhancing storage clouds using edge devices , 2011, ACE '11.

[12]  Miguel Correia,et al.  DepSky: Dependable and Secure Storage in a Cloud-of-Clouds , 2013, TOS.

[13]  Ainuddin Wahid Abdul Wahab,et al.  Cloud Log Forensics , 2016, ACM Comput. Surv..

[14]  Chuang Liu,et al.  The Unified Logging Infrastructure for Data Analytics at Twitter , 2012, Proc. VLDB Endow..

[15]  Maurizio Lenzerini,et al.  Data integration: a theoretical perspective , 2002, PODS.

[16]  Radu Calinescu,et al.  log2cloud: log-based prediction of cost-performance trade-offs for cloud deployments , 2013, SAC '13.