A Synchronization Mechanism for Cloud Accounting Systems

In current cloud systems, services run across multiple geographically distributed clusters and continuously generate resource usage data due to constant resource consumption. In the context of accounting, resource usage data generated from each cluster during service runtime must be collected and aggregated into a single cloud-wide record so that a single bill can be created. This paper presents a mechanism to synchronize accounting records among distributed accounting system peers. Run time resource usage generated from different clusters is synchronized to maintain a single cloud-wide view of the data so that a single bill can be created. We provide a set of accounting system requirements and an evaluation which verifies that the solution fulfills these requirements. Experimental results show that our solution produces less overhead in terms of data exchange and scales near-linearly with the size of clusters with no single point of failure.

[1]  Daniel J. Abadi,et al.  Calvin: fast distributed transactions for partitioned database systems , 2012, SIGMOD Conference.

[2]  Bharat Bhushan,et al.  Federated Accounting Management System Architecture for Multimedia Service Usage Management , 2002, MMNS.

[3]  Lei Gao,et al.  PRACTI Replication , 2006, NSDI.

[4]  David E. Bernholdt,et al.  The Design and Prototype of RUDA, a Distributed Grid Accounting System , 2005, ICCSA.

[5]  Hans-Arno Jacobsen,et al.  PNUTS: Yahoo!'s hosted data serving platform , 2008, Proc. VLDB Endow..

[6]  M. Herlihy A quorum-consensus replication method for abstract data types , 1986, TOCS.

[7]  Erik Elmroth,et al.  Scalable Grid‐wide capacity allocation with the SweGrid Accounting System (SGAS) , 2008, Concurr. Comput. Pract. Exp..

[8]  Fernando Gustavo Tinetti Distributed systems: principles and paradigms (2nd edition) , 2011 .

[9]  Rajkumar Buyya,et al.  GridBank: a Grid Accounting Services Architecture (GASA) for distributed systems sharing and integration , 2002, Proceedings International Parallel and Distributed Processing Symposium.

[10]  Erik Elmroth,et al.  An OGSA-Based Bank Service for Grid Accounting Systems , 2004, PARA.

[11]  Nancy A. Lynch,et al.  Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services , 2002, SIGA.

[12]  Vikas Agarwal,et al.  Metering and accounting for composite e-services , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[13]  Erik Elmroth,et al.  A Scalable Accounting Solution for Prepaid Services in Cloud Systems , 2012, 2012 IEEE Ninth International Conference on Services Computing.

[14]  Tim Kraska,et al.  MDCC: multi-data center consistency , 2012, EuroSys '13.

[15]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[16]  Erik Elmroth,et al.  Accounting and Billing for Federated Cloud Infrastructures , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[17]  Werner Vogels,et al.  Dynamo: amazon's highly available key-value store , 2007, SOSP.

[18]  Werner Vogels,et al.  Building reliable distributed systems at a worldwide scale demands trade-offs between consistency and availability. , 2022 .

[19]  Brendan Jennings,et al.  Flexible Charging for Multi-provider Composed Services using a Federated, Two-phase Rating Process , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[20]  Amin Vahdat,et al.  Design and evaluation of a continuous consistency model for replicated services , 2000, OSDI.

[21]  Adam Silberstein,et al.  Benchmarking cloud serving systems with YCSB , 2010, SoCC '10.

[22]  Stephan Flake,et al.  Third-Party-Initiated Context-Aware Real-Time Charging and Billing on an Open SOA Platform , 2008, 22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008).

[23]  Erik Elmroth,et al.  Management of distributed resource allocations in multi-cluster environments , 2012, 2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC).

[24]  Michael J. Freedman,et al.  Don't settle for eventual: scalable causal consistency for wide-area storage with COPS , 2011, SOSP.

[25]  Rajkumar Buyya,et al.  Pricing Cloud Compute Commodities: A Novel Financial Economic Model , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[26]  Prashant Malik,et al.  Cassandra: a decentralized structured storage system , 2010, OPSR.

[27]  Santosh K. Shrivastava,et al.  A Case for Consumer–centric Resource Accounting Models , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[28]  Mark Cameron,et al.  Charging for information services in Service-Oriented Architectures , 2005 .

[29]  Vyas Sekar,et al.  Verifiable resource accounting for cloud computing services , 2011, CCSW '11.

[30]  Alf Inge Wang,et al.  An Empirical Study of NetEm Network Emulation Functionalities , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[31]  Andrew S. Tanenbaum,et al.  Distributed systems: Principles and Paradigms , 2001 .

[32]  Wilson C. Hsieh,et al.  Bigtable: A Distributed Storage System for Structured Data , 2006, TOCS.

[33]  Erik Elmroth,et al.  A Cloud Environment for Data-intensive Storage Services , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.