On the Combination of Multi-Cloud and Network Coding for Cost-Efficient Storage in Industrial Applications

The adoption of both Cyber–Physical Systems (CPSs) and the Internet-of-Things (IoT) has enabled the evolution towards the so-called Industry 4.0. These technologies, together with cloud computing and artificial intelligence, foster new business opportunities. Besides, several industrial applications need immediate decision making and fog computing is emerging as a promising solution to address such requirement. In order to achieve a cost-efficient system, we propose taking advantage from spot instances, a new service offered by cloud providers, which provide resources at lower prices. The main downside of these instances is that they do not ensure service continuity and they might suffer from interruptions. An architecture that combines fog and multi-cloud deployments along with Network Coding (NC) techniques, guarantees the needed fault-tolerance for the cloud environment, and also reduces the required amount of redundant data to provide reliable services. In this paper we analyze how NC can actually help to reduce the storage cost and improve the resource efficiency for industrial applications, based on a multi-cloud infrastructure. The cost analysis has been carried out using both real AWS EC2 spot instance prices and, to complement them, prices obtained from a model based on a finite Markov chain, derived from real measurements. We have analyzed the overall system cost, depending on different parameters, showing that configurations that seek to minimize the storage yield a higher cost reduction, due to the strong impact of storage cost.

[1]  Jay Lee,et al.  A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems , 2015 .

[2]  Xavier Masip-Bruin,et al.  Foggy clouds and cloudy fogs: a real need for coordinated management of fog-to-cloud computing systems , 2016, IEEE Wireless Communications.

[3]  Muriel Médard,et al.  Network coded software defined networking: enabling 5G transmission and storage networks , 2015, IEEE Communications Magazine.

[4]  Daniel Enrique Lucani,et al.  Dynamic allocation and efficient distribution of data among multiple clouds using network coding , 2014, 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet).

[5]  Yunnan Wu,et al.  A Survey on Network Codes for Distributed Storage , 2010, Proceedings of the IEEE.

[6]  George Q. Huang,et al.  IoT-based real-time production logistics synchronization system under smart cloud manufacturing , 2016 .

[7]  Markus Lumpe,et al.  On Estimating Minimum Bids for Amazon EC2 Spot Instances , 2017, 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID).

[8]  Muriel Médard,et al.  Network Coding in the Link Layer for Reliable Narrowband Powerline Communications , 2016, IEEE Journal on Selected Areas in Communications.

[9]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[10]  Miguel Correia,et al.  DepSky: Dependable and Secure Storage in a Cloud-of-Clouds , 2013, TOS.

[11]  Ray Y. Zhong,et al.  Intelligent Manufacturing in the Context of Industry 4.0: A Review , 2017 .

[12]  Muriel Médard,et al.  XORs in the Air: Practical Wireless Network Coding , 2006, IEEE/ACM Transactions on Networking.

[13]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[14]  J. Kingman A FIRST COURSE IN STOCHASTIC PROCESSES , 1967 .

[15]  Hehua Yan,et al.  Cloud-assisted industrial cyber-physical systems: An insight , 2015, Microprocess. Microsystems.

[16]  Juergen Jasperneite,et al.  The Future of Industrial Communication: Automation Networks in the Era of the Internet of Things and Industry 4.0 , 2017, IEEE Industrial Electronics Magazine.

[17]  Daniel E. Lucani,et al.  Adaptive Network Coded Clouds: High Speed Downloads and Cost-Effective Version Control , 2019, IEEE Transactions on Cloud Computing.

[18]  Daniel E. Lucani,et al.  Reliable IoT Storage: Minimizing Bandwidth Use in Storage Without Newcomer Nodes , 2018, IEEE Communications Letters.

[19]  Laura Porcu,et al.  Cloud manufacturing as a sustainable process manufacturing route , 2018 .

[20]  G. Ram Mohana Reddy,et al.  An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment , 2018, Future Gener. Comput. Syst..

[21]  Rajkumar Buyya,et al.  Statistical Modeling of Spot Instance Prices in Public Cloud Environments , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[22]  Kyungyong Lee,et al.  DeepSpotCloud: Leveraging Cross-Region GPU Spot Instances for Deep Learning , 2017, 2017 IEEE 10th International Conference on Cloud Computing (CLOUD).

[23]  Zahid Raza,et al.  A Survey on Spot Pricing in Cloud Computing , 2017, Journal of Network and Systems Management.

[24]  Jie Li,et al.  A green and reliable communication modeling for industrial internet of things , 2017, Comput. Electr. Eng..

[25]  Yang Tang,et al.  NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds , 2014, IEEE Transactions on Computers.

[26]  Adam Barker,et al.  Location, Location, Location: Exploring Amazon EC2 Spot Instance Pricing Across Geographical Regions - Extended Version , 2018, ArXiv.

[27]  Muli Ben-Yehuda,et al.  Deconstructing Amazon EC2 Spot Instance Pricing , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[28]  Azlin Nordin,et al.  Disaster recovery in single-cloud and multi-cloud environments: Issues and challenges , 2017, 2017 4th IEEE International Conference on Engineering Technologies and Applied Sciences (ICETAS).

[29]  Yong Liang Guan,et al.  A survey of inter-flow network coding in wireless mesh networks with unicast traffic , 2015, Comput. Networks.

[30]  Tao Zhang,et al.  Fog and IoT: An Overview of Research Opportunities , 2016, IEEE Internet of Things Journal.

[31]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[32]  Jiafu Wan,et al.  Implementing Smart Factory of Industrie 4.0: An Outlook , 2016, Int. J. Distributed Sens. Networks.

[33]  Daniel E. Lucani,et al.  Towards the Tactile Internet: Decreasing Communication Latency with Network Coding and Software Defined Networking , 2015 .

[34]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[35]  Lihui Wang,et al.  Ubiquitous manufacturing system based on Cloud , 2017 .

[36]  Prem Prakash Jayaraman,et al.  Internet of Things and Edge Cloud Computing Roadmap for Manufacturing , 2016, IEEE Cloud Computing.

[37]  Josu Bilbao,et al.  Fog computing based efficient IoT scheme for the Industry 4.0 , 2017, 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM).

[38]  Jörg Widmer,et al.  Network coding: an instant primer , 2006, CCRV.

[39]  Yacine Ghamri-Doudane,et al.  Optimal Network Coding-Based In-Network Data Storage and Data Retrieval for IoT/WSNs , 2015, 2015 IEEE 14th International Symposium on Network Computing and Applications.

[40]  Yang Lu,et al.  Industry 4.0: A survey on technologies, applications and open research issues , 2017, J. Ind. Inf. Integr..

[41]  Rajkumar Buyya,et al.  Inter‐Cloud architectures and application brokering: taxonomy and survey , 2014, Softw. Pract. Exp..

[42]  Jiang Zhu,et al.  Fog Computing: A Platform for Internet of Things and Analytics , 2014, Big Data and Internet of Things.

[43]  Daniel Enrique Lucani,et al.  On network coded distributed storage: How to repair in a fog of unreliable peers , 2016, 2016 International Symposium on Wireless Communication Systems (ISWCS).

[44]  Bo Li,et al.  Towards Online Checkpointing Mechanism for Cloud Transient Servers , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.