Solving Modeling Problems with Machine Learning -- A Classification Scheme of Model Learning Approaches for Technical Systems

The manual creation and maintenance of appropriate behavior models is a key problem of model-based development for technical systems such as vehicles or production systems. Currently, two main approaches are considered promising to overcome this bottleneck: (a) The fields of software and system engineering try to develop better methods and tools to synthesize models manually. (b) The field of machine learning tries to learn such models automatically, by analyzing observations from running systems. While software and system engineering approaches are suited for new systems for which modeling expertise is at hand, machine learning approaches are suited for the handling of running systems such as monitoring, diagnosis, and system optimization. Given this background our contributions are as follows: To organize existing research, Section 2 introduces a classification scheme of models and model learning algorithms. Section 3 reports on two different case studies to illustrate the power of the machine learning approach.

[1]  Birgit Vogel-Heuser,et al.  Close integration between UML and IEC 61131-3: New possibilities through object-oriented extensions , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[2]  Frank Ortmeier,et al.  Using Deductive Cause-Consequence Analysis (DCCA) with SCADE , 2007, SAFECOMP.

[3]  Dennis M. Buede,et al.  The Engineering Design of Systems: Models and Methods , 1999 .

[4]  B. Werner,et al.  Object-oriented extensions for iec 61131-3 , 2009, IEEE Industrial Electronics Magazine.

[5]  Mirko Conrad,et al.  Testing-Based Translation Validation of Generated Code , 2011, Model-Based Testing for Embedded Systems.

[6]  Jean-Christophe Le Lann,et al.  POLYCHRONY for System Design , 2003, J. Circuits Syst. Comput..

[7]  Bran Selic,et al.  Real-Time Object-Oriented Modeling (ROOM) , 1996, RTAS 1996.

[8]  S. Inglis,et al.  Jumble Java Byte Code to Measure the Effectiveness of Unit Tests , 2007, Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007).

[9]  Ofer Strichman,et al.  Translation Validation: From Simulink to C , 2009, CAV.

[10]  Paul Pettersson,et al.  Cover - A Test-Case Generation Tool for Timed Systems , 2007 .

[11]  Joseph Y. Halpern,et al.  Causes and Explanations: A Structural-Model Approach. Part I: Causes , 2000, The British Journal for the Philosophy of Science.

[12]  Holger Giese,et al.  Real-Time Statechart Semantics , 2003 .

[13]  Frank Ortmeier,et al.  A Framework for Qualitative and Quantitative Formal Model-Based Safety Analysis , 2010, 2010 IEEE 12th International Symposium on High Assurance Systems Engineering.

[14]  Florian Leitner-Fischer,et al.  QuantUM: Quantitative Safety Analysis of UML Models , 2011, QAPL.

[15]  Hubert Garavel,et al.  Verification of GALS Systems by Combining Synchronous Languages and Process Calculi , 2009, SPIN.

[16]  B. J. Ferro Castro,et al.  Pattern-Oriented Software Architecture: A System of Patterns , 2009 .

[17]  Rolf Isermann Model-based fault-detection and diagnosis - status and applications § , 2004 .

[18]  Jean-Baptiste Raclet,et al.  Causality Analysis in Contract Violation , 2010, RV.

[19]  Amir Pnueli,et al.  Synthesis Revisited: Generating Statechart Models from Scenario-Based Requirements , 2005, Formal Methods in Software and Systems Modeling.

[20]  Jing Liu,et al.  Safety analysis of software product lines using state-based modeling , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[21]  A. Dietmair,et al.  Energy consumption modeling and optimization for production machines , 2008, 2008 IEEE International Conference on Sustainable Energy Technologies.

[22]  Kai Engelhardt,et al.  Data Refinement: Model-Oriented Proof Methods and their Comparison , 1998 .

[23]  Marco Bozzano,et al.  Improving System Reliability via Model Checking: The FSAP/NuSMV-SA Safety Analysis Platform , 2003, SAFECOMP.

[24]  Birger Møller-Pedersen,et al.  Adding Standardized Variability to Domain Specific Languages , 2008, 2008 12th International Software Product Line Conference.

[25]  Kang G. Shin,et al.  Combined Task and Message Scheduling in Distributed Real-Time Systems , 1999, IEEE Trans. Parallel Distributed Syst..

[26]  Vipin Kumar,et al.  Anomaly Detection for Discrete Sequences: A Survey , 2012, IEEE Transactions on Knowledge and Data Engineering.

[27]  Leonard J. Bass,et al.  Quality Attribute Design Primitives and the Attribute Driven Design Method , 2001, PFE.

[28]  Sicco Verwer Efficient Identification of Timed Automata: Theory and practice , 2010 .

[29]  Philippe Baufreton,et al.  SACRES: A Step Ahead in the Development of Critical Avoinics Applications (Abstract) , 1999, HSCC.

[30]  Hans-Michael Hanisch,et al.  Specification of technical plant behavior with a safety-oriented technical language , 2009, 2009 7th IEEE International Conference on Industrial Informatics.

[31]  Antony Tang,et al.  Modeling constraints improves software architecture design reasoning , 2009, 2009 Joint Working IEEE/IFIP Conference on Software Architecture & European Conference on Software Architecture.

[32]  Amir Pnueli,et al.  Symbolic Controller Synthesis for Discrete and Timed Systems , 1994, Hybrid Systems.

[33]  Robert L. Nord,et al.  A general model of software architecture design derived from five industrial approaches , 2007, J. Syst. Softw..

[34]  Florian Leitner-Fischer,et al.  Quantitative Analysis of UML Models , 2011, MBEES.

[35]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[36]  Bruno Dutertre,et al.  A Fast Linear-Arithmetic Solver for DPLL(T) , 2006, CAV.

[37]  Tamara Munzner,et al.  Exploring Large Graphs in 3D Hyperbolic Space , 1998, IEEE Computer Graphics and Applications.

[38]  Emilia Farcas,et al.  Transparent distribution of real-time components based on logical execution time , 2005, LCTES '05.

[39]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[40]  Alex Groce,et al.  Error explanation with distance metrics , 2004, International Journal on Software Tools for Technology Transfer.

[41]  Manfred Broy,et al.  AutoMoDe - Notations, Methods, and Tools for Model-Based Development of Automotive Software , 2005 .

[42]  Stefan Henkler,et al.  Component Behavior Synthesis for Critical Systems , 2010, MBEES.

[43]  Paul Gastin,et al.  Fast LTL to Büchi Automata Translation , 2001, CAV.

[44]  Hans Kleine Büning,et al.  Using behavior models for anomaly detection in hybrid systems , 2011, 2011 XXIII International Symposium on Information, Communication and Automation Technologies.

[45]  Holger Giese,et al.  Towards the compositional verification of real-time UML designs , 2003, ESEC/FSE-11.

[46]  Vipin Kumar,et al.  Comparative Evaluation of Anomaly Detection Techniques for Sequence Data , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[47]  Sandeep K. Shukla,et al.  Modeling and validating globally asynchronous design in synchronous frameworks , 2004, Proceedings Design, Automation and Test in Europe Conference and Exhibition.

[48]  Peter B. Ladkin,et al.  An Overview of IEC 61508 on E / E / PE Functional Safety , 2008 .

[49]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[50]  Vijay D'Silva,et al.  A Toolset for Modelling and Verification of GALS Systems , 2004, CAV.

[51]  Joost-Pieter Katoen,et al.  Safety, Dependability and Performance Analysis of Extended AADL Models , 2011, Comput. J..

[52]  Harald Ruess,et al.  Non-functional Avionics Requirements , 2008, ISoLA.

[53]  Nicolas Halbwachs,et al.  Simulation and Verification of Asynchronous Systems by means of a Synchronous Model , 2006, ACSD.

[54]  Nicolas Halbwachs,et al.  Virtual execution of AADL models via a translation into synchronous programs , 2007, EMSOFT '07.

[55]  Zoltán Horváth,et al.  Feldspar: A domain specific language for digital signal processing algorithms , 2010, Eighth ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMOCODE 2010).

[56]  Holger Giese,et al.  Separation of non-orthogonal concerns in software architecture and design , 2006, Software & Systems Modeling.

[57]  Michaela Huhn,et al.  Towards Certifiable Software for Medical Devices : The Pacemaker Case Study Revisited , 2011 .

[58]  Christel Baier,et al.  Principles of model checking , 2008 .

[59]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[60]  Shengbing Jiang,et al.  Failure diagnosis of discrete event systems with linear-time temporal logic fault specifications , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[61]  Thomas A. Henzinger,et al.  Giotto: a time-triggered language for embedded programming , 2001, Proc. IEEE.

[62]  Frank Ortmeier,et al.  FORMAL FAILURE MODELS , 2007 .

[63]  Mamoun Filali,et al.  Fiacre: an Intermediate Language for Model Verification in the Topcased Environment , 2008 .

[64]  Stefan Milius,et al.  Formal Safety Analysis in Industrial Practice , 2011, FMICS.

[65]  Edsger W. Dijkstra,et al.  A Discipline of Programming , 1976 .

[66]  Benoît Caillaud,et al.  Correct-by-construction asynchronous implementation of modular synchronous specifications , 2005, Fifth International Conference on Application of Concurrency to System Design (ACSD'05).

[67]  Shengbing Jiang,et al.  Failure diagnosis of discrete-event systems with linear-time temporal logic specifications , 2004, IEEE Transactions on Automatic Control.

[68]  Holger Giese,et al.  Modular design and verification of component-based mechatronic systems with online-reconfiguration , 2004, SIGSOFT '04/FSE-12.

[69]  Manfred Broy,et al.  A Functional Rephrasing of the Assumption/Commitment Specification Style , 1998, Formal Methods Syst. Des..

[70]  S. Tripakis,et al.  Tools for Controller Synthesis of Timed Systems , 2002 .

[71]  Armand Puccetti,et al.  Static Analysis of the XEN Kernel using Frama-C , 2010, J. Univers. Comput. Sci..

[72]  Leslie Lamport,et al.  Proving the Correctness of Multiprocess Programs , 1977, IEEE Transactions on Software Engineering.

[73]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[74]  Nikolaj Bjørner,et al.  Satisfiability Modulo Theories: An Appetizer , 2009, SBMF.

[75]  Neil B. Harrison,et al.  Pattern-Driven Architectural Partitioning: Balancing Functional and Non-functional Requirements , 2007, 2007 Second International Conference on Digital Telecommunications (ICDT'07).

[76]  Petru Eles,et al.  An improved scheduling technique for time-triggered embedded systems , 1999, Proceedings 25th EUROMICRO Conference. Informatics: Theory and Practice for the New Millennium.

[77]  Cliff B. Jones,et al.  Specification and Design of (Parallel) Programs , 1983, IFIP Congress.

[78]  Marsha Chechik,et al.  Synthesis of Partial Behavior Models from Properties and Scenarios , 2009, IEEE Transactions on Software Engineering.

[79]  Cees Witteveen,et al.  A Likelihood-Ratio Test for Identifying Probabilistic Deterministic Real-Time Automata from Positive Data , 2010, ICGI.

[80]  Frank Ortmeier,et al.  Model-Based Multi-objective Safety Optimization , 2011, SAFECOMP.

[81]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[82]  Robert Givan,et al.  Specific-to-general learning for temporal events , 2002, AAAI/IAAI.

[83]  Sanjoy K. Baruah,et al.  The feasibility of general task systems with precedence constraints on multiprocessor platforms , 2008, Real-Time Systems.

[84]  Christoph Herrmann,et al.  Energie- und hilfsstoffoptimierte Produktion , 2013 .

[85]  B. P. Ziegler,et al.  Theory of Modeling and Simulation , 1976 .

[86]  Man Chun Zheng,et al.  Modeling and Verification of Safety Critical Systems: A Case Study on Pacemaker , 2010, 2010 Fourth International Conference on Secure Software Integration and Reliability Improvement.

[87]  Matthias Kuntz,et al.  From Probabilistic Counterexamples via Causality to Fault Trees , 2011, SAFECOMP.

[88]  Bernard P. Zeigler,et al.  Theory of modeling and simulation , 1976 .

[89]  Roberto Passerone,et al.  Multi-Viewpoint State Machines for Rich Component Models , 2009 .

[90]  S. Karthik,et al.  Static Analysis : C Code Error Checking for Reliable and Secure Programming , 2022 .

[91]  Antoine Miné,et al.  Static Analysis of Run-Time Errors in Embedded Critical Parallel C Programs , 2011, ESOP.

[92]  Marc de Jonge,et al.  The SpinJa Model Checker , 2010, SPIN.

[93]  Thomas A. Henzinger,et al.  The Algorithmic Analysis of Hybrid Systems , 1995, Theor. Comput. Sci..

[94]  Holger Giese,et al.  Synthesis of timed behavior from scenarios in the Fujaba Real-Time Tool Suite , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[95]  Insup Lee,et al.  Assurance Cases in Model-Driven Development of the Pacemaker Software , 2010, ISoLA.

[96]  Stamatis Karnouskos,et al.  Energy efficiency driven process analysis and optimization in discrete manufacturing , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[97]  Steven P. Miller,et al.  A proposal for model-based safety analysis , 2005, 24th Digital Avionics Systems Conference.

[98]  Benno Stein,et al.  Model Construction in Analysis and Synthesis Tasks , 2001 .

[99]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[100]  Jan Bosch,et al.  Component-Oriented Programming , 2006, ECOOP Workshops.

[101]  S. D. Zemlyakov The 16th IFAC Symposium on Automatic Control in Aerospace , 2005 .

[102]  Hoyt Lougee,et al.  SOFTWARE CONSIDERATIONS IN AIRBORNE SYSTEMS AND EQUIPMENT CERTIFICATION , 2001 .

[103]  R. K. Shyamasundar,et al.  Multiclock Esterel: a reactive framework for asynchronous design , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[104]  Jean-Michel Chabloz,et al.  Globally-Ratiochronous, Locally-Synchronous Systems , 2012 .

[105]  Parosh Aziz Abdulla,et al.  Designing Safe, Reliable Systems Using Scade , 2004, ISoLA.

[106]  Birgit Vogel-Heuser,et al.  An Analytical Alarm Flood Reduction to Reduce Operator's Workload , 2011, HCI.

[107]  Pretschner,et al.  AutoFocus on Constraint Logic Programming , 2000 .

[108]  Jörg Raisch,et al.  Timed Discrete Event Control of Parallel Production Lines with Continuous Outputs , 2008, Discret. Event Dyn. Syst..

[109]  Hermann Kopetz,et al.  The Complexity Challenge in Embedded System Design , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[110]  Charles André,et al.  Semantics of S . S . M . ( Safe State Machine ) , 2003 .

[111]  Greg J. Michaelson,et al.  Hume: A Domain-Specific Language for Real-Time Embedded Systems , 2003, GPCE.

[112]  L. D. Moura,et al.  The YICES SMT Solver , 2006 .

[113]  Thomas J. Overbye,et al.  Three-Dimensional Displays as an Effective Visualization Technique for Power Systems Monitoring and Control , 2004 .

[114]  Sten Loecher,et al.  A Metamodel-Based OCL-Compiler for UML and MOF , 2004, Electron. Notes Theor. Comput. Sci..

[115]  Nicolas Halbwachs,et al.  Validation of Synchronous Reactive Systems: From Formal Verification to Automatic Testing , 1999, ASIAN.

[116]  Stanley M. Sutton,et al.  N degrees of separation: multi-dimensional separation of concerns , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[117]  H Fennel,et al.  Achievements and exploitation of the AUTOSAR development partnership , 2006 .

[118]  Claus Lewerentz,et al.  Towards Managing Software Architectures with Ontologies , 2010, Graph Transformations and Model-Driven Engineering.

[119]  Florence Maraninchi,et al.  Contract-Based Coordination of Hardware Components for the Development of Embedded Software , 2009, COORDINATION.

[120]  Ingolf Krüger,et al.  A Verification Approach for GALS Integration of Synchronous Components , 2005, FMGALS@MEMOCODE.

[121]  Matthias Riebisch,et al.  Impact Evaluation for Quality-Oriented Architectural Decisions regarding Evolvability , 2010, ECSA.

[122]  Thomas Lukasiewicz,et al.  Complexity results for structure-based causality , 2001, Artif. Intell..

[123]  John A. Clark,et al.  Holistic schedulability analysis for distributed hard real-time systems , 1994, Microprocess. Microprogramming.

[124]  George S. Avrunin,et al.  Patterns in property specifications for finite-state verification , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[125]  Andrew Hinton,et al.  PRISM: A Tool for Automatic Verification of Probabilistic Systems , 2006, TACAS.

[126]  Oliver Niggemann,et al.  Anomaly Detection in Production Plants using Timed Automata - Automated Learning of Models from Observations , 2011, ICINCO.

[127]  Ahmed Tamrawi,et al.  Fuzzy set and cache-based approach for bug triaging , 2011, ESEC/FSE '11.

[128]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[129]  Janos Sztipanovits,et al.  Using separation of concerns for embedded systems design , 2005, EMSOFT.

[130]  Frank Ortmeier,et al.  Deductive cause-consequence analysis (DCCA) , 2005 .

[131]  Ilan Beer,et al.  Explaining counterexamples using causality , 2009, Formal Methods in System Design.

[132]  Kang G. Shin,et al.  Assignment and Scheduling Communicating Periodic Tasks in Distributed Real-Time Systems , 1997, IEEE Trans. Software Eng..

[133]  Willem P. de Roever,et al.  The Need for Compositional Proof Systems: A Survey , 1997, COMPOS.

[134]  Nicolas Halbwachs,et al.  Synchronous Observers and the Verification of Reactive Systems , 1993, AMAST.

[135]  Terence Parr The Definitive ANTLR Reference: Building Domain-Specific Languages , 2007 .

[136]  G. Aiello,et al.  An Agile methodology for Manufacturing Control Systems development , 2007, 2007 5th IEEE International Conference on Industrial Informatics.

[137]  Holger Hermanns,et al.  A Markov Chain Model Checker , 2000, TACAS.

[138]  Gerard J. M. Smit,et al.  Run-time Spatial Mapping of Streaming Applications to a Heterogeneous Multi-Processor System-on-Chip (MPSOC) , 2007, 2008 Design, Automation and Test in Europe.

[139]  William Stallings,et al.  SNMP, SNMPv2, SNMPv3, and RMON 1 and 2 , 1999 .

[140]  Andreas Zeller,et al.  Why Programs Fail: A Guide to Systematic Debugging , 2005 .

[141]  Margus Veanes,et al.  Testing Concurrent Object-Oriented Systems with Spec Explorer , 2005, FM.

[142]  David L Hayes,et al.  The Revised NASPE/BPEG Generic Code for Antibradycardia, Adaptive‐Rate, and Multisite Pacing , 2002, Pacing and clinical electrophysiology : PACE.

[143]  Wolfram Schulte,et al.  Semantic essence of AsmL , 2005, Theor. Comput. Sci..

[144]  Ricardo Mayo Bayón,et al.  MIOOP. An object oriented programming paradigm approach on the IEC 61131 standard , 2010, 2010 IEEE 15th Conference on Emerging Technologies & Factory Automation (ETFA 2010).

[145]  Harald Albrecht,et al.  On Meta-Modeling for Communication in Operational Process Control Engineering , 2003 .

[146]  Florian Leitner-Fischer,et al.  DiPro - A Tool for Probabilistic Counterexample Generation , 2011, SPIN.

[147]  Ned Hall,et al.  Causation and counterfactuals , 2004 .

[148]  Martin Fränzle,et al.  Scheduling distributed real-time systems by satisfiability checking , 2005, 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA'05).

[149]  Babak Hamidzadeh,et al.  Dynamic scheduling strategies for shared-memory multiprocessors , 1996, Proceedings of 16th International Conference on Distributed Computing Systems.