Capabilities of Raspberry Pi 2 for Big Data and Video Streaming Applications in Data Centres

Many new data centres have been built in recent years in order to keep up with the rising demand for server capacity. These data centres require a lot of electrical energy and cooling. Big data and video streaming are two heavily used applications in data centres. This paper experimentally investigates the possibilities and benefits of using cheap, low power and widely supported hardware in the form of a micro data centre with big data and video streaming as its main application area. For this purpose, multiple Raspberry Pi 2 Model B (RPi2)’s have been used in order to build a fully functional distributed Hadoop and video streaming setup that has acceptable performance and extends to new research opportunities. We experimentally validated the new setup to fit in a data centre environment by analysis of its performance, scalability, energy consumption, temperature and manageability. This paper proposes a high concurrency and low power setup in a small 1U form factor with an estimated number of 72 RPi2’s as an interesting alternative to traditional rack servers.

[1]  Jaspal Subhlok,et al.  General-purpose blade infrastructure for configurable system architectures , 2007, Distributed and Parallel Databases.

[2]  Steven J. Johnston,et al.  Iridis-pi: a low-cost, compact demonstration cluster , 2014, Cluster Computing.

[3]  Muthu Dayalan,et al.  MapReduce : Simplified Data Processing on Large Cluster , 2018 .

[4]  Sven Helmer,et al.  Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[5]  Fung Po Tso,et al.  The Glasgow Raspberry Pi Cloud: A Scale Model for Cloud Computing Infrastructures , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops.

[6]  Maurizio Portolani,et al.  Data Center Fundamentals , 2003 .

[7]  Jaspal Subhlok,et al.  General-purpose blade infrastructure for configurable system architectures , 2007, Distributed and Parallel Databases.

[8]  Ellen-Louise Bleeker,et al.  Creating a Raspberry Pi-Based Beowulf Cluster , 2017 .

[9]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[10]  Joshua Kiepert Creating a Raspberry Pi-Based Beowulf Cluster , 2013 .

[11]  Shengsheng Huang,et al.  HiBench : A Representative and Comprehensive Hadoop Benchmark Suite , 2012 .

[12]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[13]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.