Prototype of a Scalable Monitoring Infrastructure for Industrial DevOps

The digitalization of the conventional, manufacturing industry poses great opportunities but also challenges. As industrial devices, machines, and plants become more intelligent and autonomous, an increasing challenge for business enterprises is to connect and integrate them. This leads to the fact that software plays an increasing role in the daily production processes. In particular, small and medium-sized enterprises have to take high risks caused by high investment costs and a lack of experience in the development of distributed software systems. Agile and iterative methods, such as those that have long been common in other fields of IT, can be a solution to that. Industrial DevOps is an approach to apply those methods and bridge the gap between the development and the operation of software in industrial production environments. To facilitate this, development and operation are considered as a coherent, cyclic, and continuous process. Therefore, Industrial DevOps requires a continuously monitoring of all different aspects within a production. In this thesis, we present an approach for a monitoring infrastructure for industrial production environments such as factories. It facilitates the integration of different types of sensors in order to make their measurements comparable. Automatically and in real time, recorded data is analyzed and visualized in a number of ways. Due to its microservice-based architecture, our monitoring infrastructure is designed to scale with the production size and to adapt to frequently changing requirements. This is supported by applying open source big data tools that have demonstrated their capabilities in similar challenges of Internet-scale systems. Moreover, to face the challenges of scalability and real-time data processing, our approach unites the principles of cloud and edge computing. We implemented a prototype that covers all aspects of the designed architecture. This prototype is deployed in a medium-sized enterprise, where we monitored the electrical power consumption of a server, to show the feasibility of our approach. Furthermore, our approach shows scalability characteristics even though it is not always achieved reliably. Therefore, we present possible solutions to increase the reliability.

[1]  Christian Brecher,et al.  Industrial Internet of Things and Cyber Manufacturing Systems , 2017 .

[2]  Charles Anderson,et al.  Docker , 2015, IEEE Softw..

[3]  M. Anusha,et al.  Big Data-Survey , 2016 .

[4]  Samuel Kounev,et al.  Elasticity in Cloud Computing: What It Is, and What It Is Not , 2013, ICAC.

[5]  S. Lewandowsky,et al.  Displaying proportions and percentages , 1991 .

[6]  Myassar Hazzouri,et al.  Bachelor’s thesis , 2015 .

[7]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[8]  Michael Fisher,et al.  The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise , 2009 .

[9]  Wilhelm Hasselbring,et al.  Software landscape and application visualization for system comprehension with ExplorViz , 2017, Inf. Softw. Technol..

[10]  Wilhelm Hasselbring,et al.  ExplorViz: Visual Runtime Behavior Analysis of Enterprise Application Landscapes , 2015, ECIS.

[11]  Marco Jahn,et al.  Designing a Smart City Internet of Things Platform with Microservice Architecture , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[12]  Richard Berntsson-Svensson,et al.  On the journey to continuous deployment: Technical and social challenges along the way , 2015, Inf. Softw. Technol..

[13]  Birgit Vogel-Heuser,et al.  Challenges for Software Engineering in Automation , 2014 .

[14]  Sven Ulrich,et al.  Improving Kieker′s Scalability by Employing Linked Read- Optimized and Write-Optimized NoSQL Storage , 2016, Softwaretechnik-Trends.

[15]  Wilhelm Hasselbring,et al.  Microservice Architectures for Scalability, Agility and Reliability in E-Commerce , 2017, 2017 IEEE International Conference on Software Architecture Workshops (ICSAW).

[16]  Wilhelm Hasselbring,et al.  Kieker: a framework for application performance monitoring and dynamic software analysis , 2012, ICPE '12.

[17]  M. Harrison Theories of Abstract Automata. Michael A. Arbib. Prentice-Hall, Englewood Cliffs, N.J., 1969. xviii, 414 pp., illus. $14.95. Prentice-Hall Series in Automatic Computation , 1970 .

[18]  Wilhelm Hasselbring,et al.  OCEANTEA: EXPLORING OCEAN-DERIVED CLIMATE DATA OCEANTEA: EXPLORING OCEAN-DERIVED CLIMATE DATA USING MICROSERVICES , 2016 .

[19]  L. Youseff,et al.  Toward a Unified Ontology of Cloud Computing , 2008, 2008 Grid Computing Environments Workshop.

[20]  Mark Persoff UK , 1999, EC Tax Review.

[21]  Andrew S. Tanenbaum,et al.  Distributed systems - principles and paradigms, 2nd Edition , 2007 .

[22]  Maurizio A. Spirito,et al.  Prototyping the Internet of Things for the future factory using a SOA-based middleware and reliable WSNs , 2013, 2013 IEEE 18th Conference on Emerging Technologies & Factory Automation (ETFA).

[23]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[24]  Stefan Hauck-Stattelmann,et al.  Container-based architecture for flexible industrial control applications , 2018, J. Syst. Archit..

[25]  Teruo Higashino,et al.  Edge-centric Computing: Vision and Challenges , 2015, CCRV.

[26]  M. Shaw Larger scale systems require higher-level abstractions , 1989, IWSSD '89.

[27]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[28]  Wilhelm Hasselbring,et al.  Microservices for Scalability: Keynote Talk Abstract , 2016, ICPE.

[29]  Prashant Malik,et al.  Cassandra: a decentralized structured storage system , 2010, OPSR.

[30]  Wilhelm Hasselbring,et al.  Continuous Monitoring of Software Services: Design and Application of the Kieker Framework , 2009 .

[31]  Holger Knoche Refactoring Kieker's I/O Infrastructure to Improve Scalability and Extensibility , 2017, Softwaretechnik-Trends.

[32]  Parameswaran Ramanathan,et al.  Real-time computing: a new discipline of computer science and engineering , 1994, Proc. IEEE.

[33]  Nathan Marz,et al.  Big Data: Principles and best practices of scalable realtime data systems , 2015 .

[34]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[35]  J. Paul Morrison,et al.  Flow-Based Programming, 2nd Edition: A New Approach to Application Development , 2010 .

[36]  Wilhelm Hasselbring,et al.  Elastic Application-Level Monitoring for Large Software Landscapes in the Cloud , 2015, ESOCC.

[37]  Wilhelm Hasselbring,et al.  Parallel and Generic Pipe-and-Filter Architectures with TeeTime , 2017, 2017 IEEE International Conference on Software Architecture Workshops (ICSAW).

[38]  Pasi Kuvaja,et al.  Dimensions of DevOps , 2015, XP.

[39]  Antonín Steinhauser,et al.  DOs and DON'Ts of Conducting Performance Measurements in Java , 2015, ICPE.

[40]  Matteo Petracca,et al.  Industrial Internet of Things monitoring solution for advanced predictive maintenance applications , 2017, J. Ind. Inf. Integr..

[41]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[42]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[43]  Roy Fielding,et al.  Architectural Styles and the Design of Network-based Software Architectures"; Doctoral dissertation , 2000 .

[44]  David Bernstein,et al.  Containers and Cloud: From LXC to Docker to Kubernetes , 2014, IEEE Cloud Computing.

[45]  S. Mohan,et al.  Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software [Book Review] , 2003, IEEE Software.

[46]  Christian Wulf,et al.  Refactoring Kieker′s Monitoring Component to Further Reduce the Runtime Overhead , 2016, Softwaretechnik-Trends.