Fast Subspace Identification Method Based on Containerised Cloud Workflow Processing System

Subspace identification (SID) has been widely used in system identification and control fields since it can estimate system models only relying on the input and output data by reliable numerical operations such as singular value decomposition (SVD). However, high-dimension Hankel matrices are involved to store these data and used to obtain the system models, which increases the computation amount of SID and leads SID not suitable for the large-scale or real-time identification tasks. In this paper, a novel fast SID method based on cloud workflow processing and container technology is proposed to accelerate the traditional algorithm. First, a workflow-based structure of SID is designed to match the distributed cloud environment, based on the computational feature of each calculation stage. Second, a containerised cloud workflow processing system is established to execute the logicand datadependent SID workflow mission based on Kubernetes system. Finally, the experiments show that the computation time is reduced by at most 91.6% for large-scale SID mission and decreased to within 20 ms for the real-time mission parameter.

[1]  Rubén Ruiz,et al.  Scheduling Stochastic Multi-Stage Jobs to Elastic Hybrid Cloud Resources , 2018, IEEE Transactions on Parallel and Distributed Systems.

[2]  Alex Pothen,et al.  Fast Parallel Stochastic Subspace Algorithms for Large-Scale Ambient Oscillation Monitoring , 2017, IEEE Transactions on Smart Grid.

[3]  Sherali Zeadally,et al.  Container-as-a-Service at the Edge: Trade-off between Energy Efficiency and Service Availability at Fog Nano Data Centers , 2017, IEEE Wireless Communications.

[4]  Hidenori Kimura,et al.  Recursive 4SID algorithms using gradient type subspace tracking , 2002, Autom..

[5]  Hongzi Mao,et al.  Learning scheduling algorithms for data processing clusters , 2018, SIGCOMM.

[6]  Yuanqing Xia,et al.  Data-driven predictive control for networked control systems , 2013, Inf. Sci..

[7]  Albert Y. Zomaya,et al.  Energy-Efficient Workflow Scheduling Using Container-Based Virtualization in Software-Defined Data Centers , 2020, IEEE Transactions on Industrial Informatics.

[8]  Bart De Moor,et al.  Subspace Identification for Linear Systems: Theory ― Implementation ― Applications , 2011 .

[9]  Michel Verhaegen,et al.  Recursive Predictor-Based Subspace Identification With Application to the Real-Time Closed-Loop Tracking of Flutter , 2012, IEEE Transactions on Control Systems Technology.

[10]  Å. Björck.  Numerical Methods in Matrix Computations , 2014 .

[11]  Laurent Mevel,et al.  Efficient Multi-Order Uncertainty Computation for Stochastic Subspace Identification , 2013 .

[12]  Richard Boateng,et al.  Cloud computing research: A review of research themes, frameworks, methods and future research directions , 2018, Int. J. Inf. Manag..

[13]  C. P. Katti,et al.  Cost effective deadline aware scheduling strategy for workflow applications on virtual machines in cloud computing , 2017, J. King Saud Univ. Comput. Inf. Sci..

[14]  Kenli Li,et al.  A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment , 2017, IEEE Transactions on Parallel and Distributed Systems.

[15]  Felipe Núñez,et al.  A Container-based IoT-oriented Programmable Logical Controller , 2020, 2020 IEEE Conference on Industrial Cyberphysical Systems (ICPS).

[16]  Kenli Li,et al.  Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems , 2017, Inf. Sci..

[17]  Michel Verhaegen,et al.  Subspace identification of individual systems in a large-scale heterogeneous network , 2019, Autom..

[18]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[19]  Qingbo Wu,et al.  Workflow scheduling in cloud: a survey , 2015, The Journal of Supercomputing.

[20]  Johan Nilsson,et al.  Real-Time Control Systems with Delays , 1998 .

[21]  Stefan Hauck-Stattelmann,et al.  Container-based architecture for flexible industrial control applications , 2018, J. Syst. Archit..

[22]  Kenli Li,et al.  MalFCS: An effective malware classification framework with automated feature extraction based on deep convolutional neural networks , 2020, J. Parallel Distributed Comput..