Energy efficiency of Zipf traffic distributions within Facebook's data center fabric architecture

Open architectures like the one recently unveiled by Facebook allow a detailed assessment of the energy efficiency of commercial data centers. This paper explores the fit of Zipf-like distributions typical of network traffic, to updates of user pages and the entity graph, for the new Facebook data center network architecture. We find that network resource consumption could be reduced by as much as 40-50% through several changes, either to the software, or to the data center design. Of these, employing a connected hub-and-spoke subgraph representation for each popular node, with each pod operating locally on its node of the subgraph, appears to hold the most energy savings potential. This work is part of a larger effort to more completely characterize the efficiency of data center computer-and network architectures beyond the normal reporting of facility power utilization efficiency (PUE), which is blind to energy proportionality and other aspects of the efficiency within the computer- and network architecture, or IT portion, of the data center.

[1]  Antonio Fernández,et al.  Bisection (Band)Width of Product Networks with Application to Data Centers , 2012, IEEE Transactions on Parallel and Distributed Systems.

[2]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[3]  Daniel C. Kilper,et al.  Energy Challenges in Current and Future Optical Transmission Networks , 2012, Proceedings of the IEEE.

[4]  Xiaowen Dong,et al.  Green IP Over WDM Networks With Data Centers , 2011, Journal of Lightwave Technology.

[5]  Amin Vahdat,et al.  Data Center Switch Architecture in the Age of Merchant Silicon , 2009, 2009 17th IEEE Symposium on High Performance Interconnects.

[6]  Laurent Lefèvre,et al.  A survey on techniques for improving the energy efficiency of large-scale distributed systems , 2014, ACM Comput. Surv..

[7]  Sujata Banerjee,et al.  ElasticTree: Saving Energy in Data Center Networks , 2010, NSDI.

[8]  Steven Glassman,et al.  A Caching Relay for the World Wide Web , 1994, Comput. Networks ISDN Syst..

[9]  J. Koomey Worldwide electricity used in data centers , 2008 .

[10]  Peter M. Athanas,et al.  A global perspective on energy conservation in large data networks , 2014, 2014 24th International Workshop on Power and Timing Modeling, Optimization and Simulation (PATMOS).

[11]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[12]  Dario Rossi,et al.  Apples-to-apples: a framework analysis for energy-efficiency in networks , 2011, PERV.

[13]  Athanasios V. Vasilakos,et al.  GreenDCN: A General Framework for Achieving Energy Efficiency in Data Center Networks , 2013, IEEE Journal on Selected Areas in Communications.

[14]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[15]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[16]  Hong Liu,et al.  Energy proportional datacenter networks , 2010, ISCA.

[17]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[18]  Yonggang Wen,et al.  Toward monetary cost effective content placement in cloud centric media network , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[19]  Lisa J. K. Durbeck Graph measures of network content-delivery energy , 2015, 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[20]  Biswanath Mukherjee,et al.  Energy-efficient content distribution over telecom network infrastructure , 2011, 2011 13th International Conference on Transparent Optical Networks.

[21]  Nathan Farrington,et al.  Facebook's data center network architecture , 2013, 2013 Optical Interconnects Conference.

[22]  Charles E. Leiserson,et al.  Fat-trees: Universal networks for hardware-efficient supercomputing , 1985, IEEE Transactions on Computers.