A Systematic Mapping Study on the Verification of Cyber-Physical Systems

Cyber-physical system (CPS) is a kind of complex real-time hybrid system which involves deep interactions between computation processors, communication network, and physical environments are deemed as the key enablers of next generation computer applications. However, how to verify CPS effectively is always a great challenge. Based on current scientific works about CPS verification, this paper aims at identifying the gap of current studies and suggesting promising areas for the future works. For this purpose, we conduct a systematic mapping study over the topic on verification of cyber-physical system. We carry out a widely search of publications from 2006 to 2018 in 11 electronic databases. After the step of study selection, 80 papers are selected as primary studies for answering proposed research questions, focused questions, and statistical questions. According to these questions and their answers, this paper not only presents a quantitative and comprehensive analysis of verification challenges, abstraction methods, verification techniques, assistance tools, and verification scenarios that represent each step of verification works, but also summarizes CPS systematic natures, main routine of verification and future research directions. We believe that this survey can identify gaps in current research works and reveal new insights for the future works.

[1]  Claes Wohlin,et al.  Agile Practices in Global Software Engineering - A Systematic Map , 2010, 2010 5th IEEE International Conference on Global Software Engineering.

[2]  Dag Nyström,et al.  Towards the verification of temporal data consistency in Real-Time Data Management , 2016, 2016 2nd International Workshop on Modelling, Analysis, and Control of Complex CPS (CPS Data).

[3]  Ashutosh Trivedi,et al.  Hybrid Automata for Formal Modeling and Verification of Cyber-Physical Systems , 2013, ArXiv.

[4]  Richard M. Murray,et al.  Verification of Periodically Controlled Hybrid Systems: Application to an Autonomous Vehicle , 2012, TECS.

[5]  Long Zhang,et al.  A Formal Approach to Verify Parameterized Protocols in Mobile Cyber-Physical Systems , 2017, Mob. Inf. Syst..

[6]  Jin Cui,et al.  A Novel Approach to Modeling and Verifying Real-Time Systems for High Reliability , 2018, IEEE Transactions on Reliability.

[7]  Wang Jie,et al.  Energy Consumption Analysis Method of CPS Software Based on Architecture Modeling , 2015, 2015 Ninth International Conference on Frontier of Computer Science and Technology.

[8]  David Sinclair,et al.  Modelling and verification of cyber-physical system , 2010 .

[9]  Liang Hu,et al.  Review of Cyber-Physical System Architecture , 2012, 2012 IEEE 15th International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing Workshops.

[10]  Xiaoqing Frank Liu,et al.  Verifying Noninterference in a Cyber-Physical System The Advanced Electric Power Grid , 2007, Seventh International Conference on Quality Software (QSIC 2007).

[11]  Leon Wu,et al.  FARE: A framework for benchmarking reliability of cyber-physical systems , 2013, 2013 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[12]  Lothar Thiele,et al.  Conformance testing for cyber-physical systems , 2012, TECS.

[13]  Leonidas Tsiopoulos,et al.  DTRON: a tool for distributed model-based testing of time critical applications , 2017 .

[14]  Kuldip S. Rattan,et al.  Controller verification in adaptive learning systems towards trusted autonomy , 2015, ICCPS.

[15]  Lui Sha,et al.  Modeling and integrating physical environment assumptions in medical cyber-physical system design , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[16]  Christine Julien,et al.  Perceptions on the State of the Art in Verification and Validation in Cyber-Physical Systems , 2017, IEEE Systems Journal.

[17]  Xiaowei Li,et al.  Integrated simulation and emulation platform for cyber-physical system security experimentation , 2012, HiCoNS '12.

[18]  Sebastian Fischmeister,et al.  Runtime Monitoring of Cyber-Physical Systems Under Timing and Memory Constraints , 2015, ACM Trans. Embed. Comput. Syst..

[19]  Christine Julien,et al.  Verification and Validation in Cyber Physical Systems: Research Challenges and a Way Forward , 2015, 2015 IEEE/ACM 1st International Workshop on Software Engineering for Smart Cyber-Physical Systems.

[20]  Eun-Young Kang,et al.  Model-based Verification and Validation of an Autonomous Vehicle System , 2018, ArXiv.

[21]  Andreas Gerstlauer,et al.  SimConnect and SimTalk for distributed cyber-physical system simulation , 2013, Simul..

[22]  K. A. Loparo,et al.  A mathematic framework for analysis of complex cyber-physical power systems , 2012, 2012 IEEE Power and Energy Society General Meeting.

[23]  Michael W. Whalen,et al.  On Implementing Real-Time Specification Patterns Using Observers , 2016, NFM.

[24]  Yu Zhang,et al.  Cyber/Physical Co-verification for Developing Reliable Cyber-physical Systems , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference.

[25]  Jing Lin,et al.  Towards Integrated Simulation of Cyber-Physical Systems: A Case Study on Intelligent Water Distribution , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[26]  Maciej J. Zawodniok,et al.  Stability of a Cyber-physical Smart Grid System Using Cooperating Invariants , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference.

[27]  Taylor T. Johnson,et al.  CyFuzz: A Differential Testing Framework for Cyber-Physical Systems Development Environments , 2016, CyPhy.

[28]  Md. Rafiqul Islam,et al.  Defending unknown attacks on cyber-physical systems by semi-supervised approach and available unlabeled data , 2017, Inf. Sci..

[29]  Lionel C. Briand,et al.  Test Generation and Test Prioritization for Simulink Models with Dynamic Behavior , 2019, IEEE Transactions on Software Engineering.

[30]  Liqian Chen,et al.  Runtime Monitoring for Cyber-physical Systems: A Case Study of Cooperative Adaptive Cruise Control , 2012, 2012 Second International Conference on Intelligent System Design and Engineering Application.

[31]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[32]  Chen-Ching Liu,et al.  ICT modeling for integrated simulation of cyber-physical power systems , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[33]  Federica Pascucci,et al.  Monitoring system reaction in cyber-physical testbed under cyber-attacks , 2017, Comput. Electr. Eng..

[34]  Karl Meinke,et al.  Learning-Based Testing of Cyber-Physical Systems-of-Systems: A Platooning Study , 2017, EPEW.

[35]  Olaf Stursberg,et al.  Verification of a Cruise Control System using Counterexample-Guided Search , 2004 .

[36]  Shiyan Hu,et al.  Design Automation of Cyber-Physical Systems: Challenges, Advances, and Opportunities , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[37]  Haifeng Chen,et al.  A Data Analytic Engine Towards Self-Management of Cyber-Physical Systems , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops.

[38]  Klaas Sikkel,et al.  A systematic mapping study on empirical evaluation of software requirements specifications techniques , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[39]  Hareton K. N. Leung,et al.  Regression Testing of Web Service: A Systematic Mapping Study , 2014, ACM Comput. Surv..

[40]  Riccardo Taormina,et al.  Real-Time Detection of Cyber-Physical Attacks on Water Distribution Systems Using Deep Learning , 2017 .

[41]  Matthias Althoff,et al.  Safety verification of autonomous vehicles for coordinated evasive maneuvers , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[42]  Taylor T. Johnson,et al.  Static and Dynamic Analysis of Timed Distributed Traces , 2012, 2012 IEEE 33rd Real-Time Systems Symposium.

[43]  Farhad Arbab,et al.  A Compositional Framework for Preference-Aware Agents , 2016, V2CPS@IFM.

[44]  Augusto Sampaio,et al.  A Process for Sound Conformance Testing of Cyber-Physical Systems , 2017, 2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[45]  Arun Kumar Sangaiah,et al.  A short-term traffic prediction model in the vehicular cyber-physical systems , 2017, Future Gener. Comput. Syst..

[46]  Yier Jin,et al.  Quantifying trust in autonomous system under uncertainties , 2016, 2016 29th IEEE International System-on-Chip Conference (SOCC).

[47]  Radoslaw Klimek,et al.  Towards deductive-based support for software development processes , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[48]  Sagar Chaki,et al.  Verifying cyber-physical systems by combining software model checking with hybrid systems reachability , 2016, 2016 International Conference on Embedded Software (EMSOFT).

[49]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[50]  Wang Yi,et al.  Towards a Tool: TIMES-Pro for Modeling, Analysis, Simulation and Implementation of Cyber-Physical Systems , 2017, Models, Algorithms, Logics and Tools.

[51]  Zhang Yu,et al.  Research on modeling and analysis of CPS , 2011, ATC 2011.

[52]  Christine Julien,et al.  Efficient and Scalable Runtime Monitoring for Cyber–Physical System , 2018, IEEE Systems Journal.

[53]  Takeru Kuroiwa,et al.  Testing Environment for CPS by Cooperating Model Checking with Execution Testing , 2016, KES.

[54]  Chris J. Myers,et al.  Automatic abstraction for verification of cyber-physical systems , 2010, ICCPS '10.

[55]  Howard Barringer,et al.  A Formal Framework for User Centric Control of Probabilistic Multi-agent Cyber-Physical Systems , 2009, CLIMA.

[56]  Felicita Di Giandomenico,et al.  Statistical model checking of an energy-saving cyber-physical system in the railway domain , 2017, SAC.

[57]  Patricia Bouyer,et al.  Timed-Automata Abstraction of Switched Dynamical Systems Using Control Funnels , 2015, FORMATS.

[58]  Gabriela Magureanu,et al.  Validation of static properties in unified modeling language models for cyber physical systems , 2013, Journal of Zhejiang University SCIENCE C.

[59]  Diego N. Brandão,et al.  Towards the Modular Specification and Validation of Cyber-Physical Systems , 2018, ICCSA.

[60]  Cyrille Jégourel,et al.  Feedback Control for Statistical Model Checking of Cyber-Physical Systems , 2016, ISoLA.

[61]  Kuldip S. Rattan,et al.  Piecewise Affine Hybrid Automata Representation of a Multistage Fuzzy PID Controller , 2014, AAAI Spring Symposia.

[62]  Huiqun Yu,et al.  A TAOPN Approach to Modeling and Scheduling Cyber-Physical Systems , 2013, 2013 International Conference on Information Science and Applications (ICISA).

[63]  Jayaraj Poroor,et al.  Formal analysis of event-driven cyber physical systems , 2012, SecurIT '12.

[64]  Yang Li,et al.  An Analysis of Cyber Physical System Security Theories , 2014, 2014 7th International Conference on Security Technology.

[65]  Tao Li,et al.  From Offline toward Real-Time : A Hybrid Systems Model Checking and CPS Co-Design Approach for Medical Device Plug-and-Play ( MDPnP ) , 2012 .

[66]  Sérgio Soares,et al.  A Systematic Mapping Study on Software Engineering Testbeds , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[67]  Lui Sha,et al.  Data-Centered Runtime Verification of Wireless Medical Cyber-Physical System , 2017, IEEE Transactions on Industrial Informatics.

[68]  A Q Huang,et al.  The Future Renewable Electric Energy Delivery and Management (FREEDM) System: The Energy Internet , 2011, Proceedings of the IEEE.

[69]  Radu Grosu,et al.  Cyber-physical systems: challenge of the 21st century , 2016, e & i Elektrotechnik und Informationstechnik.

[70]  Husheng Li,et al.  Introduction to cyber physical systems , 2016 .

[71]  Flemming Nielson,et al.  Quantitative modelling and analysis of a Chinese smart grid: a stochastic model checking case study , 2014, International Journal on Software Tools for Technology Transfer.

[72]  Heather Goldsby,et al.  Modular verification of dynamically adaptive systems , 2009, AOSD '09.

[73]  Osman Hasan,et al.  Formal Verification of Cyber-Physical Systems: Coping with Continuous Elements , 2013, ICCSA.

[74]  Nathan Fulton,et al.  A logic of proofs for differential dynamic logic: toward independently checkable proof certificates for dynamic logics , 2016, CPP.

[75]  Mohammad Reza Mousavi,et al.  A Tool Prototype for Model-Based Testing of Cyber-Physical Systems , 2015, ICTAC.

[76]  Shuo Yang,et al.  An AOP-Based Robot Behaviors Safety Checking Method , 2015, 2015 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration.

[77]  Ingo Schmitt,et al.  Monitoring mobile cyber-physical systems by means of a knowledge discovery cycle , 2013, IEEE 7th International Conference on Research Challenges in Information Science (RCIS).

[78]  Janos Sztipanovits,et al.  Multi-way Semantic Specification of Domain-Specific Modeling Languages , 2013, 2013 20th IEEE International Conference and Workshops on Engineering of Computer Based Systems (ECBS).

[79]  Stefano Bistarelli,et al.  A Formal and Run-Time Framework for the Adaptation of Local Behaviours to Match a Global Property , 2016, FACS.

[80]  Sandeep Neema,et al.  Specification of Cyber-Physical Components with Formal Semantics - Integration and Composition , 2013, MoDELS.

[81]  Jing Liu,et al.  Specifying Cyber Physical System Safety Properties with Metric Temporal Spatial Logic , 2015, 2015 Asia-Pacific Software Engineering Conference (APSEC).

[82]  Wilhelm Schäfer,et al.  Domain-Specific Model Checking for Cyber-Physical Systems , 2015, MoDeVVa@MoDELS.

[83]  Marcello M. Bersani,et al.  Online verification in cyber‐physical systems: Practical bounds for meaningful temporal costs , 2018, J. Softw. Evol. Process..

[84]  Aitor Arrieta,et al.  Test control algorithms for the validation of cyber-physical systems product lines , 2015, SPLC.

[85]  Sridhar Adepu,et al.  Anomaly Detection in Cyber Physical Systems Using Recurrent Neural Networks , 2017, 2017 IEEE 18th International Symposium on High Assurance Systems Engineering (HASE).

[86]  Aji Gautama Putrada,et al.  Cyber physical system: Paper survey , 2014, 2014 International Conference on ICT For Smart Society (ICISS).

[87]  Daniel Moldovan,et al.  A Platform for Run-Time Health Verification of Elastic Cyber-Physical Systems , 2016, 2016 IEEE 24th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS).

[88]  Peter Rooney,et al.  American Competitiveness Initiative , 2006 .

[89]  Toni Mancini,et al.  On minimising the maximum expected verification time , 2017, Inf. Process. Lett..

[90]  Maciej J. Zawodniok,et al.  Invariants as a unified knowledge model for Cyber-Physical Systems , 2011, 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[91]  G Santhosh Kumar,et al.  Modeling and verification of timed automaton based hybrid systems using spin model checker , 2016, 2016 IEEE Annual India Conference (INDICON).

[92]  Sergiy Bogomolov,et al.  Runtime Verification for Hybrid Analysis Tools , 2015, RV.

[93]  Mohammad Abdollahi Azgomi,et al.  A method for modeling and evaluation of the security of cyber-physical systems , 2014, 2014 11th International ISC Conference on Information Security and Cryptology.

[94]  H. Suri.  Systematic Reviews in the Social Sciences: A Practical Guide [Book Review] , 2009 .

[95]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[96]  Insup Lee,et al.  Parameter-Invariant Monitor Design for Cyber–Physical Systems , 2018, Proceedings of the IEEE.

[97]  Neeraj Suri,et al.  Practical Use of Formal Verification for Safety Critical Cyber-Physical Systems: A Case Study , 2014, 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications.

[98]  Shin Nakajima,et al.  Modeling and debugging numerical constraints of cyber-physical systems design , 2013, SoICT.

[99]  Philip Koopman,et al.  Monitor Based Oracles for Cyber-Physical System Testing: Practical Experience Report , 2014, 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks.