CYRUS: towards client-defined cloud storage

Public cloud storage has recently surged in popularity. However, cloud storage providers (CSPs) today offer fairly rigid services, which cannot be customized to meet individual users' needs. We propose a distributed, client-defined architecture that integrates multiple autonomous CSPs into one unified cloud and allows individual clients to specify their desired performance levels and share files. We design, implement, and deploy CYRUS (Client-defined privacY-protected Reliable cloUd Service), a practical system that realizes this architecture. CYRUS ensures user privacy and reliability by scattering files into smaller pieces across multiple CSPs, so that no one CSP can read users' data. We develop an algorithm that sets reliability and privacy parameters according to user needs and selects CSPs from which to download user data so as to minimize latency. To accommodate multiple autonomous clients, we allow clients to upload simultaneous file updates and detect conflicts after the fact from the client. We finally evaluate the performance of a CYRUS prototype that connects to four popular commercial CSPs in both lab testbeds and user trials, and discuss CYRUS's implications for the cloud storage market.

[1]  Yongwei Wu,et al.  µLibCloud: Providing High Available and Uniform Accessing to Multiple Cloud Storages , 2012, 2012 ACM/IEEE 13th International Conference on Grid Computing.

[2]  Yang Tang,et al.  NCCloud: applying network coding for the storage repair in a cloud-of-clouds , 2012, FAST.

[3]  Jason Lango.  Toward software-defined SLAs , 2014, CACM.

[4]  Adi Shamir,et al.  How to share a secret , 1979, CACM.

[5]  Miguel Correia,et al.  SCFS: A Shared Cloud-backed File System , 2014, USENIX Annual Technical Conference.

[6]  Michael Dahlin,et al.  Minimal Byzantine Storage , 2002, DISC.

[7]  Michael K. Reiter,et al.  Efficient Byzantine-tolerant erasure-coded storage , 2004, International Conference on Dependable Systems and Networks, 2004.

[8]  Ari Juels,et al.  HAIL: a high-availability and integrity layer for cloud storage , 2009, CCS.

[9]  Veena Rawat,et al.  Reducing Failure Probability of cloud storage services using Multi-Clouds , 2013, ArXiv.

[10]  Stefano Tessaro,et al.  Optimal Resilience for Erasure-Coded Byzantine Distributed Storage , 2005, International Conference on Dependable Systems and Networks (DSN'06).

[11]  Wilson C. Hsieh,et al.  Bigtable: A Distributed Storage System for Structured Data , 2006, TOCS.

[12]  Werner Vogels,et al.  Dynamo: amazon's highly available key-value store , 2007, SOSP.

[13]  Aiko Pras,et al.  Inside dropbox: understanding personal cloud storage services , 2012, Internet Measurement Conference.

[14]  Guilherme Sperb Machado,et al.  A Cloud Storage overlay to aggregate heterogeneous Cloud services , 2013, 38th Annual IEEE Conference on Local Computer Networks.

[15]  Carlos Maltzahn,et al.  Ceph: a scalable, high-performance distributed file system , 2006, OSDI '06.

[16]  Michael K. Reiter,et al.  Byzantine quorum systems , 1997, STOC '97.

[17]  David R. Karger,et al.  Web Caching with Consistent Hashing , 1999, Comput. Networks.

[18]  Karl Aberer,et al.  Scalia: An adaptive scheme for efficient multi-cloud storage , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[19]  P. Veríssimo,et al.  USENIX ATC ’ 14 : 2014 USENIX Annual Technical Conference is sponsored by USENIX . SCFS : A Shared Cloud-backed File System , 2014 .

[20]  Alexander Schill,et al.  Building a Flexible Service Architecture for User Controlled Hybrid Clouds , 2012, 2012 Seventh International Conference on Availability, Reliability and Security.

[21]  Jérôme Darmont,et al.  Sharing-based Privacy and Availability of Cloud Data Warehouses , 2013, EDA.

[22]  R. J. McEliece,et al.  On sharing secrets and Reed-Solomon codes , 1981, CACM.

[23]  James S. Plank,et al.  AONT-RS: Blending Security and Performance in Dispersed Storage Systems , 2011, FAST.

[24]  Anwitaman Datta,et al.  InterCloud RAIDer: A Do-It-Yourself Multi-cloud Private Data Backup System , 2014, ICDCN.

[25]  Miguel Correia,et al.  DepSky: Dependable and Secure Storage in a Cloud-of-Clouds , 2013, TOS.

[26]  Hakim Weatherspoon,et al.  RACS: a case for cloud storage diversity , 2010, SoCC '10.

[27]  Michael K. Reiter,et al.  Secure and scalable replication in Phalanx , 1998, Proceedings Seventeenth IEEE Symposium on Reliable Distributed Systems (Cat. No.98CB36281).