Verification of Adaptive Systems

Adaptive systems are critical for future space and other unmanned and intelligent systems. Verification of these systems is also critical for their use in systems with potential harm to human life or with large financial investments. Due to their nondeterministic nature and extremely large state space, current methods for verification of software systems are not adequate to provide a high level of assurance for them. The combination of stabilization science, high performance computing simulations, compositional verification and traditional verification techniques, plus operational monitors, provides a complete approach to verification and deployment of adaptive systems that has not been used before. This paper gives an overview of this approach.

[1]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[2]  Roy Sterritt,et al.  You Can't Get There from Here! Large Problems and Potential Solutions in Developing New Classes of Complex Computer Systems , 2012, Conquering Complexity.

[3]  Moustafa Ghanem,et al.  Real-Time Data Mining Methodology and a Supporting Framework , 2009, 2009 Third International Conference on Network and System Security.

[4]  Darío Maravall,et al.  Adaptation, anticipation and rationality in natural and artificial systems: computational paradigms mimicking nature , 2008 .

[5]  M. Tarafdar Haque,et al.  Application of Neural Networks in Power Systems; A Review , 2007 .

[6]  T. Hrycej.  Neural-network-based car drive train control , 1992, [1992 Proceedings] Vehicular Technology Society 42nd VTS Conference - Frontiers of Technology.

[7]  Robi Malik,et al.  A compositional approach for verifying generalised nonblocking , 2009, 2009 IEEE International Conference on Control and Automation.

[8]  Eugene Lavretsky,et al.  Adaptive Control and the NASA X-15-3 Flight Revisited , 2010, IEEE Control Systems.

[9]  Brian Randell,et al.  Fundamental Concepts of Computer System Dependability , 2001 .

[10]  Shonali Krishnaswamy,et al.  Mining data streams: a review , 2005, SGMD.

[11]  Chengyu Cao,et al.  Design and Analysis of a Novel L1 Adaptive Controller, Part I: Control Signal and Asymptotic Stability , 2006, 2006 American Control Conference.

[12]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Ogden Nash,et al.  You Can't Get There From Here , 1957 .

[14]  Paul R. Work.  Special Session on Certification of Dynamic and Adaptive Systems , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[15]  Tamio Fukuzawa,et al.  Model-Based Predictive Adaptive Control of Pulp and Paper Mill Processes , 2006 .

[16]  J.J. Burken,et al.  Adaptive Control Using Neural Network Augmentation for a Modified F-15 Aircraft , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[17]  H. Basher.  Autonomous Control of Nuclear Power Plants , 2003 .

[18]  John J. Burken,et al.  Flight Test Comparison of Different Adaptive Augmentations of Fault Tolerant Control Laws for a Modified F-15 Aircraft , 2009 .

[19]  Eui-Nam Huh.  Certification of real-time performance for dynamic, distributed real-time systems , 2002 .

[20]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[21]  Brian J. Taylor,et al.  Verification and validation of neural networks: a sampling of research in progress , 2003, SPIE Defense + Commercial Sensing.

[22]  John A. McDermid,et al.  Safety Cases for Advanced Control Software , 2007 .

[23]  B. Gough.  Advanced Predictive Adaptive Control of Steam Header Pressure, Saveall Consistency and Reel Brightness in a TMP Newsprint Mill , 2002 .

[24]  Marek Olszewski,et al.  Kendo: efficient deterministic multithreading in software , 2009, ASPLOS.

[25]  Zeshan Kurd,et al.  Artificial Neural Networks in Safety-critical Applications , 2002 .

[26]  Danil V. Prokhorov,et al.  Toyota Prius HEV neurocontrol and diagnostics , 2008, Neural Networks.

[27]  R. R. Zakrzewski.  Verification of performance of a neural network estimator , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[28]  Rajeev Chandramohan,et al.  Adaptive critic flight control for a general aviation aircraft: Simulations for the beech bonanza fly-by-wire testbed , 2007 .

[29]  David Kim,et al.  IMPROVED METHODOLOGY FOR THE PREDICTION OF THE EMPENNAGE MANEUVER IN- FLIGHT LOADS OF A GENERAL AVIATION AIRCRAFT USING NEURAL NETWORKS. , 2001 .

[30]  R. R. Zakrzewski.  Fuel volume measurement in aircraft using neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[31]  Anthony J. Calise,et al.  Intelligent aerodynamic/propulsion flight control for flight safety: a nonlinear adaptive approach , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[32]  Eric N. Johnson,et al.  Adaptive Flight Control for an Autonomous Unmanned Helicopter , 2002 .

[33]  Brian D. O. Anderson,et al.  Failures of adaptive control theory and their resolution , 2005, Commun. Inf. Syst..

[34]  John Kaneshige,et al.  Projection Operator: A Step Towards Certification of Adaptive Controllers , 2010 .

[35]  Kalmanje Krishnakumar,et al.  A Hybrid Intelligent Flight Control with Adaptive Learning Parameter Estimation , 2007 .

[36]  Roy Sterritt,et al.  Swarm Technology at NASA: Building Resilient Systems , 2012, IT Professional.

[37]  Ellen J. Bass,et al.  Architecture and development environment of a knowledge-based monitor that facilitate incremental knowledge-base development , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[39]  Frank L. Lewis,et al.  Neural net robot controller with guaranteed tracking performance , 1995, IEEE Trans. Neural Networks.

[40]  John J. Burken,et al.  Neural Network Applications in Advanced Aircraft Flight Control System, a Hybrid System, a Flight Test Demonstration , 2006, ICONIP.

[41]  L. Harrison,et al.  ARTIFICIAL INTELLIGENCE WITH APPLICATIONS FOR AIRCRAFT , 1994 .

[42]  John A. McDermid,et al.  Safety Cases for Advanced Control Software: Safety Case Patterns , 2007 .

[43]  R. R. Zakrzewski.  Verification of a trained neural network accuracy , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[44]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[45]  V.A. Carreno,et al.  A case-study application of RTCA DO-254: design assurance guidance for airborne electronic hardware , 2000, 19th DASC. 19th Digital Avionics Systems Conference. Proceedings (Cat. No.00CH37126).

[46]  A. Lambregts.  Vertical flight path and speed control autopilot design using total energy principles , 1983 .

[47]  D. B. Cunningham.  Adaptive control of sulfur recovery units , 1994 .

[48]  John Rushby,et al.  A Safety-Case Approach For Certifying Adaptive Systems , 2009 .

[49]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[50]  Robi Malik,et al.  Seven abstraction rules preserving generalised nonblocking , 2009 .

[51]  Howard Kaufman,et al.  Digital adaptive flight controller development , 1973, CDC 1973.

[52]  David Kim,et al.  Methodology to Predict the Empennage In-Flight Loads of a General Aviation Aircraft Using Backpropagation Neural Networks , 2001 .

[53]  Yoshua Bengio,et al.  Scaling learning algorithms towards AI , 2007 .

[54]  Robert M. O'Keefe,et al.  Developing a strategy for expert system verification and validation , 1994, IEEE Trans. Syst. Man Cybern..

[55]  Jozef Hooman,et al.  Concurrency Verification: Introduction to Compositional and Noncompositional Methods , 2001, Cambridge Tracts in Theoretical Computer Science.

[56]  Stefan Preitl,et al.  Stability and Sensitivity Analysis of Fuzzy Control Systems. Mechatronics Applications , 2006 .

[57]  Robert A. Vivona,et al.  Pattern-Based Genetic Algorithm for Airborne Conflict Resolution , 2006 .

[58]  Nhan T. Nguyen,et al.  Hybrid Intelligent Flight Control with Adaptive Learning Parameter Estimation , 2009, J. Aerosp. Comput. Inf. Commun..

[59]  Ali Mili,et al.  Towards the verification and validation of online learning systems: general framework and applications , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[60]  Bojan Cukic,et al.  Monitoring techniques for an online neuro-adaptive controller , 2006, J. Syst. Softw..

[61]  John J. Burken,et al.  Verification and Validation of Real-time Adaptive Neural Networks using ANCT Tools and Methodologies, an application to Intelligent Flight Control Systems F-15 Project , 2005 .

[62]  Jesper Andersson,et al.  Modeling Dimensions of Self-Adaptive Software Systems , 2009, Software Engineering for Self-Adaptive Systems.

[63]  David Robertson,et al.  Industrial Use of Safety-Related Expert Systems , 2000 .

[64]  Daniel Clancy,et al.  Verification and Validation of Neural Networks for Aerospace Systems , 2002 .

[65]  Wing Ho Cheung,et al.  Neural network aided aviation fuel consumption modeling , 1997 .

[66]  Daniel E. O'Leary,et al.  Expert system verification and validation: a survey and tutorial , 1993, Artificial Intelligence Review.

[67]  E. Lavretsky,et al.  Adaptive Compensation of Control Dependent Modeling Uncertainties using Time-Scale Separation , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[68]  Johann Schumann,et al.  A tool for verification and validation of neural network based adaptive controllers for high assurance systems , 2004, Eighth IEEE International Symposium on High Assurance Systems Engineering, 2004. Proceedings..

[69]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[70]  Heather Goldsby,et al.  Modular verification of dynamically adaptive systems , 2009, AOSD '09.

[71]  Guy A. Dumont,et al.  Concepts, methods and techniques in adaptive control , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[72]  Mihai Huzmezan,et al.  A new generation of adaptive model based predictive controllers applied in batch reactor temperature control , 1999, IEEE Industry Applications Society Advanced Process Control Applications for Industry Workshop.

[73]  P. Gupta,et al.  Toward Verification and Validation of Adaptive Aircraft Controllers , 2005, 2005 IEEE Aerospace Conference.

[74]  Noel Duerksen,et al.  Fuzzy Logic Decoupled Longitudinal Control for General Aviation Airplanes , 1996 .

[75]  Tomohisa Hayakawa,et al.  Direct Adaptive Control for Nonlinear Uncertain Dynamical Systems , 2003 .

[76]  Pam Haley,et al.  Pilots Rate Augmented Generalized Predictive Control for Reconfiguration , 2004 .

[77]  Mary Shaw,et al.  Software Engineering for Self-Adaptive Systems: A Research Roadmap , 2009, Software Engineering for Self-Adaptive Systems.

[78]  Chengyu Cao,et al.  Stability Margins of ${\cal L}_{1}$ Adaptive Control Architecture , 2010, IEEE Transactions on Automatic Control.

[79]  Meng Joo Er,et al.  Reinforcement Learning in Generating Fuzzy Systems , 2009 .

[80]  Anthony J. Calise.  Neural Network Based Adaptive Control of Uncertain and Unknown Nonlinear Systems , 2001 .

[81]  Naira Hovakimyan,et al.  Are phase and time-delay margins always adversely affected by high-gain? , 2006 .

[82]  Martin Leucker.  Runtime Verification, 8th International Workshop, RV 2008, Budapest, Hungary, March 30, 2008. Selected Papers , 2008, RV.

[83]  Farokh B. Bastani,et al.  Optimal Adaptive System Health Monitoring and Diagnosis for Resource Constrained Cyber-Physical Systems , 2009, 2009 20th International Symposium on Software Reliability Engineering.

[84]  Bojan Cukic.  The need for verification and validation techniques for adaptive control system , 2001, Proceedings 5th International Symposium on Autonomous Decentralized Systems.

[85]  Brian C. Williams,et al.  Model-based programming of intelligent embedded systems and robotic space explorers , 2003, Proc. IEEE.

[86]  Bojan Cukic,et al.  Lyapunov Analysis of Neural Network Stability in an Adaptive Flight Control System , 2003, Self-Stabilizing Systems.

[87]  John Rushby.  How Do We Certify For The Unexpected , 2008 .

[88]  John J. Burken,et al.  A Flight Test Demonstration of On-line Neural Network Applications in Advanced Aircraft Flight Control System , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[89]  Johann Schumann,et al.  Toward V&V of neural network based controllers , 2002, WOSS '02.

[90]  D M Rodvold,et al.  Validation and regulation of medical neural networks. , 2001, Molecular urology.

[91]  R.A. Hull,et al.  Validation & Verification of Intelligent and Adaptive Control Systems , 2005, 2005 IEEE Aerospace Conference.

[92]  Eric N. Johnson,et al.  FEEDBACK LINEARIZATION WITH NEURAL NETWORK AUGMENTATION APPLIED TO X-33 ATTITUDE CONTROL , 2000 .

[93]  Bojan Cukic,et al.  Lyapunov stability analysis of the quantization error for DCS neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[94]  Tim Kelly,et al.  Safety Lifecycle for Developing Safety Critical Artificial Neural Networks , 2003, SAFECOMP.

[95]  Timothy L. Johnson,et al.  Validation and Verification of Intelligent and Adaptive Control Systems (VVIACS) , 2004 .

[96]  Bojan Cukic,et al.  A validation approach for neural network‐based online adaptive systems , 2006, Softw. Pract. Exp..

[97]  Stephen A. Jacklin,et al.  Closing the Certification Gaps in Adaptive Flight Control Software , 2008 .

[98]  John Rushby,et al.  Critical system properties: survey and taxonomy , 1994 .

[99]  C. O'Halloran,et al.  Certification of autonomous systems , 2013 .

[100]  S. Sastry,et al.  Adaptive Control: Stability, Convergence and Robustness , 1989 .

[101]  Rainer Müller,et al.  Engine Control using Neural Networks: A New Method in Engine Management Systems , 1997 .

[102]  Anthony J. Calise,et al.  Hierarchical Approach to Adaptive Control for Improved Flight Safety , 2001 .

[103]  Mehrdad Ehsani,et al.  Aircraft Power Systems , 2003 .

[104]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[105]  David M. Rodvold.  A software development process model for artificial neural networks in critical applications , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[106]  Bojan Cukic,et al.  Validating neural network-based online adaptive systems: a case study , 2007, Software Quality Journal.

[107]  Reid G. Simmons,et al.  RIACS Workshop on the Verification and Validation of Autonomous and Adaptive Systems , 2001, AI Mag..

[108]  Sanjay Garg,et al.  Propulsion Control Technology Development in the United States A Historical Perspective , 2005 .

[109]  Kenneth A. Loparo,et al.  Verification and Validation Methodology of Real-Time Adaptive Neural Networks for Aerospace Applications , 2004 .

[110]  Jim Austin,et al.  Developing artificial neural networks for safety critical systems , 2006, Neural Computing and Applications.

[111]  Brian J. Taylor,et al.  Rule Extraction From Dynamic Cell Structure Neural Network Used in a Safety Critical Application , 2004, FLAIRS.

[112]  Naira Hovakimyan,et al.  Verifiable L1 Adaptive Controller for Aerial Refueling , 2007 .

[113]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[114]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[115]  K. Keller,et al.  Verification of Flight Software with Karnough Map-based Checking , 2007, 2007 IEEE Aerospace Conference.

[116]  David Clarke,et al.  Self-tuning control , 1979 .

[117]  E. Mosca.  Optimal, Predictive and Adaptive Control , 1994 .

[118]  Johann Schumann,et al.  On Verification & Validation of Neural Network Based Controllers , 2003 .

[119]  Jeffrey S. Vetter,et al.  Autopilot: adaptive control of distributed applications , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[120]  P. G. J. Lisboa.  Neural Networks: Current Applications , 1992 .

[121]  Bo K. Wong,et al.  Neural network applications in business: A review and analysis of the literature (1988-1995) , 1997, Decis. Support Syst..

[122]  D. Ward,et al.  Verification and validation of neural networks for safety-critical applications , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[123]  Johann Schumann,et al.  Verification, Validation, and Certification Challenges for Adaptive Flight-Critical Control System Software , 2004 .

[124]  Jan Jantzen,et al.  A Tutorial On Adaptive Fuzzy Control , 2002 .

[125]  Naira Hovakimyan,et al.  Design and Analysis of a Novel ${\cal L}_1$ Adaptive Control Architecture With Guaranteed Transient Performance , 2008, IEEE Transactions on Automatic Control.

[126]  A. Schulte.  Cognitive Automation for Tactical Mission Management: Concept and Prototype Evaluation in Flight Simulator Trials , 2002, Cognition, Technology & Work.

[127]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[128]  Mehrdad Ehsani,et al.  Aircraft power systems: technology, state of the art, and future trends , 2000 .

[129]  Marc Bodson,et al.  Multivariable adaptive algorithms for reconfigurable flight control , 1997, IEEE Trans. Control. Syst. Technol..

[130]  Mary Shaw,et al.  Engineering Self-Adaptive Systems through Feedback Loops , 2009, Software Engineering for Self-Adaptive Systems.

[131]  Chengyu Cao,et al.  Design and Analysis of a Novel L1 Adaptive Controller, Part II: Guaranteed Transient Performance , 2006, 2006 American Control Conference.

[132]  Jiang Wang,et al.  Verifiable Adaptive Flight Control: UCAV and Aerial Refueling , 2008 .

[133]  Laura L. Pullum,et al.  Verification and Validation of Neural Networks - Guidance , 2007 .

[134]  Jih-Gau Juang,et al.  Intelligent Fuzzy Systems for Aircraft Landing Control , 2005, FSKD.

[135]  Ivica Crnkovic,et al.  Classification of quality attributes for predictability in component-based systems , 2004 .

[136]  John M. Rushby,et al.  Runtime Certification , 2008, RV.

[137]  Christel Baier,et al.  Principles of model checking , 2008 .

[138]  P. Eng,et al.  Predictive-adaptive temperature control of molten glass , 1997, IEEE Industry Applications Society Dynamic Modeling Control Applications for Industry Workshop.

[139]  M. Cameron,et al.  Implementation of an innovative self-tuning adaptive controller for complex industrial processes , 1990, 37th Annual Conference on Petroleum and Chemical Industry.

[140]  Johann Schumann,et al.  Development of Advanced Verification and Validation Procedures and Tools for the Certification of Learning Systems in Aerospace Applications , 2005 .

[141]  Jerry M. Mendel,et al.  Fuzzy adaptive filters, with application to nonlinear channel equalization , 1993, IEEE Trans. Fuzzy Syst..

[142]  Trefor P. Williams,et al.  Using neural networks to predict component inspection requirements for aging aircraft , 1996 .

[143]  Irene M. Gregory,et al.  L(sub 1) Adaptive Control Design for NASA AirSTAR Flight Test Vehicle , 2009 .

[144]  Robert A. Vivona,et al.  Experimental Performance of a Genetic Algorithm for Airborne Strategic Conflict Resolution , 2008 .

[145]  Irene M. Gregory,et al.  L(sub 1) Adaptive Flight Control System: Flight Evaluation and Technology Transition , 2010 .

[146]  Hans Engström,et al.  Adaptive process control in laser robotic welding , 2003 .

[147]  Cheng Qiming,et al.  Model-Free Adaptive Control Method for Nuclear Steam Generator Water Level , 2010, 2010 International Conference on Intelligent Computation Technology and Automation.

[148]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[149]  Jacob J. Hageman,et al.  Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control , 2003 .

[150]  M. Buscema,et al.  The general philosophy of Artificial Adaptive Systems , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[151]  Anthony J. Calise,et al.  Neural-adaptive nonlinear autopilot design for an agile anti-air missile , 1996 .