A Hybrid Approach to Microservices Load Balancing

During the past few years, microservices have been becoming a common architectural pattern increasingly used to realize flexible and scalable service-based applications. Microservices have grown in popularity as a mainstay in the business environment, allowing companies to increase development and maintenance speed, predict performance and scale, with scalability being one of the most important nonfunctional requirements to be fulfilled. Load balancing is the most prominent approach in support of scalability. In the realm of microservices, one usually distinguishes between two types of load balancers, namely, client-side and server-side load balancers. This work proposes a novel hybrid approach to microservices load balancing that combines the benefits of client-side and server-side load balancing.

[1]  Pooyan Jamshidi,et al.  Migrating to Cloud-Native Architectures Using Microservices: An Experience Report , 2015, ESOCC Workshops.

[2]  Todd C. Mowry.  Introduction to Special Issue APLOS 2011 , 2012, TOCS.

[3]  Olaf Zimmermann,et al.  Microservices tenets , 2017, Computer Science - Research and Development.

[4]  Yaowadee Temtanapat,et al.  Design and implementation of a decentralized message bus for microservices , 2016, 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[5]  Huan Liu,et al.  On direct routing in the valiant load-balancing architecture , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[6]  Andre B. Bondi,et al.  Characteristics of scalability and their impact on performance , 2000, WOSP '00.

[7]  Luciano Baresi,et al.  Supporting the Decision of Migrating to Microservices Through Multi-layer Fuzzy Cognitive Maps , 2017, ICSOC.

[8]  Riccardo Rizzo,et al.  The Database-is-the-Service Pattern for Microservice Architectures , 2016, ITBAM.

[9]  Michael Fisher,et al.  The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise , 2009 .

[10]  Marco Jahn,et al.  Designing a Smart City Internet of Things Platform with Microservice Architecture , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[11]  Luciano Baresi,et al.  Empowering Low-Latency Applications Through a Serverless Edge Computing Architecture , 2017, ESOCC.

[12]  Xiaohui Gu,et al.  AGILE: Elastic Distributed Resource Scaling for Infrastructure-as-a-Service , 2013, ICAC.

[13]  André van Hoorn,et al.  A Quantitative Approach for the Assessment of Microservice Architecture Deployment Alternatives by Automated Performance Testing , 2018, ECSA.

[14]  Divyanand Malavalli,et al.  Scalable microservice based architecture for enabling DMTF profiles , 2015, 2015 11th International Conference on Network and Service Management (CNSM).

[15]  Samuel Kounev,et al.  Elasticity in Cloud Computing: What It Is, and What It Is Not , 2013, ICAC.

[16]  Takuya Nakaike,et al.  Workload characterization for microservices , 2016, 2016 IEEE International Symposium on Workload Characterization (IISWC).

[17]  H. Zeiner,et al.  SeCoS: Web of Things platform based on a microservices architecture and support of time-awareness , 2016, Elektrotech. Informationstechnik.

[18]  Dmitry Namiot,et al.  On micro-services architecture , 2014 .

[19]  Patricia Lago,et al.  Research on Architecting Microservices: Trends, Focus, and Potential for Industrial Adoption , 2017, 2017 IEEE International Conference on Software Architecture (ICSA).

[20]  Mor Harchol-Balter,et al.  AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers , 2012, TOCS.

[21]  Mohamed Cheriet,et al.  Micro Service Cloud Computing Pattern for Next Generation Networks , 2015, ArXiv.

[22]  Claus Pahl,et al.  Architectural Patterns for Microservices: A Systematic Mapping Study , 2018, CLOSER.

[23]  Björn Butzin,et al.  Microservices approach for the internet of things , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[24]  Giovanni Toffetti Carughi,et al.  An architecture for self-managing microservices , 2015, AIMC '15.

[25]  Claus Pahl,et al.  Benchmark requirements for microservices architecture research , 2017 .

[26]  Cesare Pautasso,et al.  Microservices in Practice, Part 1: Reality Check and Service Design , 2017, IEEE Software.