Achieving Isolation in Mixed-Criticality Industrial Edge Systems with Real-Time Containers (Artifact)

Real-time containers are a promising solution to reduce latencies in time-sensitive cloud systems. Recent efforts are emerging to extend their usage in industrial edge systems with mixed-criticality constraints. In these contexts, isolation becomes a major concern: a disturbance (such as timing faults or unexpected overloads) affecting a container must not impact the behavior of other containers deployed on the same hardware. In this paper, we propose a novel architectural solution to achieve isolation in real-time containers, based on real-time co-kernels, hierarchical scheduling, and time-division networking. The architecture has been implemented on Linux patched with the Xenomai co-kernel, extended with a new hierarchical scheduling policy, named SCHED_DS , and integrating the RTNet stack. Experimental results are promising in terms of overhead and latency compared to other Linux-based solutions. More importantly, the isolation of containers is guaranteed even in presence of severe co-located disturbances, such as faulty tasks (elapsing more time than declared) or high CPU, network, or I/O stress on the same machine. on Docker containers on a PREEMPT_RT -based Linux kernel, in the context of an automotive scenario. In [29] a container-based architecture for real-time automation controllers is proposed, using Docker and LXC containers on top of a Linux patched with the PREEMPT_RT real-time kernel patch. Experiments have been done using both Docker and LXC containers running on top of a Linux OS patched with the PREEMPT_RT real-time kernel patch. Tests emphasize that the use of containers for control applications can meet the requirements of the target systems.

[1]  Tommaso Cucinotta,et al.  Strong Temporal Isolation Among Containers in OpenStack for NFV Services , 2023, IEEE Transactions on Cloud Computing.

[2]  T. Cucinotta,et al.  RT-kubernetes: containerized real-time cloud computing , 2022, SAC.

[3]  Aleteia P. F. Araujo,et al.  Orchestration in Fog Computing: A Comprehensive Survey , 2022, ACM Comput. Surv..

[4]  Domenico Cotroneo,et al.  Virtualizing Mixed-Criticality Systems: A Survey on Industrial Trends and Issues , 2021, Future Gener. Comput. Syst..

[5]  Silviu S. Craciunas,et al.  REACT: Enabling Real-Time Container Orchestration , 2021, 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA ).

[6]  M. Cinque,et al.  Preventing timing failures in mixed-criticality clouds with dynamic real-time containers , 2021, European Dependable Computing Conference.

[7]  Jose-Luis Poza-Lujan,et al.  The Role of Mixed Criticality Technology in Industry 4.0 , 2021, Electronics.

[8]  Marco Platzner,et al.  DeepWind: An Accurate Wind Turbine Condition Monitoring Framework via Deep Learning on Embedded Platforms , 2020, 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[9]  Filip De Turck,et al.  FLEDGE: Kubernetes Compatible Container Orchestration on Low-Resource Edge Devices , 2020, IOV.

[10]  Tommaso Cucinotta,et al.  Container-based real-time scheduling in the Linux kernel , 2019, SIGBED.

[11]  Marcello Cinque,et al.  RT-CASEs: Container-Based Virtualization for Temporally Separated Mixed-Criticality Task Sets , 2019, ECRTS.

[12]  Bum-Jae You,et al.  Real-time control architecture based on Xenomai using ROS packages for a service robot , 2019, J. Syst. Softw..

[13]  Dipankar Raychaudhuri,et al.  Hetero-Edge: Orchestration of Real-time Vision Applications on Heterogeneous Edge Clouds , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[14]  Alexander Verl,et al.  A Container-based Architecture for Real-Time Control Applications , 2018, 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC).

[15]  Stefan Hauck-Stattelmann,et al.  Container-based architecture for flexible industrial control applications , 2018, J. Syst. Archit..

[16]  Mohsen Guizani,et al.  Edge Computing in the Industrial Internet of Things Environment: Software-Defined-Networks-Based Edge-Cloud Interplay , 2018, IEEE Communications Magazine.

[17]  Andreas Seitz,et al.  Seamless Computing for Industrial Systems Spanning Cloud and Edge , 2017, 2017 International Conference on High Performance Computing & Simulation (HPCS).

[18]  Fang Fang,et al.  Design of controller system for industrial robot based on RTOS Xenomai , 2017, 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[19]  Christian Berger,et al.  Systematic evaluation of sandboxed software deployment for real-time software on the example of a self-driving heavy vehicle , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[20]  Shripad Deshpande,et al.  Implementation of CAN Bus Protocol on XENOMAI RTOS on ARM Platform for Industrial Automation , 2016, 2016 International Conference on Computation of Power, Energy Information and Commuincation (ICCPEIC).

[21]  Cheng-Hsin Hsu,et al.  Minimizing Latency of Real-Time Container Cloud for Software Radio Access Networks , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[22]  Neeraj Suri,et al.  Mitigating Timing Error Propagation in Mixed-Criticality Automotive Systems , 2015, 2015 IEEE 18th International Symposium on Real-Time Distributed Computing.

[23]  Aaron D. Ames,et al.  The Ach Library: A New Framework for Real-Time Communication , 2015, IEEE Robotics & Automation Magazine.

[24]  Insup Lee,et al.  Real-time multi-core virtual machine scheduling in Xen , 2014, 2014 International Conference on Embedded Software (EMSOFT).

[25]  A. Toso,et al.  Real-Time and Real-Fast Performance of General-Purpose and Real-Time Operating Systems in Multithreaded Physical Simulation of Complex Mechanical Systems , 2014 .

[26]  Carlos Garre,et al.  Performance Comparison of Real-Time and General-Purpose Operating Systems in Parallel Physical Simulation with High Computational Cost , 2014 .

[27]  Sanjoy K. Baruah,et al.  Mixed-Criticality Real-Time Scheduling for Multicore Systems , 2010, 2010 10th IEEE International Conference on Computer and Information Technology.

[28]  Alan Burns,et al.  Hierarchical fixed priority pre-emptive scheduling , 2005, 26th IEEE International Real-Time Systems Symposium (RTSS'05).

[29]  J. Kiszka,et al.  RTnet - a flexible hard real-time networking framework , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[30]  Jane W.-S. Liu,et al.  Scheduling real-time applications in an open environment , 1997, Proceedings Real-Time Systems Symposium.

[31]  L. Mezzalira Real-time systems , 1996, J. Syst. Archit..

[32]  John P. Lehoczky,et al.  The rate monotonic scheduling algorithm: exact characterization and average case behavior , 1989, [1989] Proceedings. Real-Time Systems Symposium.

[33]  Guido Wirtz,et al.  Profiling Lightweight Container Platforms: MicroK8s and K3s in Comparison to Kubernetes , 2021, ZEUS.

[34]  Moris Behnam,et al.  Real-Time Containers: A Survey , 2020, Fog-IoT.

[35]  Tommaso Cucinotta,et al.  Demystifying the Real-Time Linux Scheduling Latency , 2020, ECRTS.

[36]  Marko Bertogna,et al.  Bao: A Lightweight Static Partitioning Hypervisor for Modern Multi-Core Embedded Systems , 2020, NG-RES@HiPEAC.

[37]  W. Fornaciari,et al.  The Real-Time Linux Kernel , 2019, ACM Comput. Surv..

[38]  Dirk Schaefer,et al.  Software-defined cloud manufacturing for industry 4.0 , 2016 .

[39]  Robert I. Davis,et al.  Mixed Criticality Systems - A Review , 2015 .

[40]  Felipe Cerqueira,et al.  A Comparison of Scheduling Latency in Linux, PREEMPT-RT, and LITMUS RT , 2013 .

[41]  M. Masmano,et al.  XtratuM: a Hypervisor for Safety Critical Embedded Systems , 2012 .

[42]  Robert I. Davis,et al.  An Investigation into Server Parameter Selection for Hierarchical Fixed Priority Pre-emptive Systems , 2008 .