Automatic test generation techniques for analog circuits and systems: A review

The purpose of this paper is both a review and an assessment of techniques presently available for automatic test generation for analog systems. After recalling the general problems of automatic testing (definitions, faults in analog systems, different types of tests, main operations, and diagnosis procedures), characterization and description modes of analog systems, and the main software ingredients of automatic test equipment, a categorization of known techniques along several criteria can be proposed. Then, several techniques, respectively, proceeding from approaches based on deterministic and probabilistic estimation, taxonomical and topological analyses can be detailed. Techniques specific to linear systems (several of them belonging to the above three categories) are dealt with in a separate section. The main features of the techniques that are described are summed up in five synoptic tables. As a conclusion, several research areas that need further investigation in view of a possible industrial implementation of automatic analog test generation techniques are identified. Two appendixes deal briefly with fault tolerance and fault simulation in analog systems. An extensive bibliography ( \sim 500 entries) is provided.

[1]  P.D.R. Towill.  Design of system simulations for effective evaluation of analog test techniques , 1978 .

[2]  G. Stein,et al.  Specific failure identification algorithms for the F-8 , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[3]  D. R. Towill,et al.  Predicting servomechanism dynamic performance variation from limited production test data , 1970 .

[4]  R. Berkowitz.  Conditions for Network-Element-Value Solvability , 1962 .

[5]  P.L. Lin,et al.  Identification of linear time-invariant system using exponential curve fitting , 1977, Proceedings of the IEEE.

[6]  W. Rugh,et al.  Further results on the identification problem for the class of nonlinear systems S_M , 1976 .

[7]  P. M. Chirlian,et al.  Application of a Bilinear Theorem to Network Sensitivity , 1965 .

[8]  K. Godfrey.  The Theory of the Correlation Method of Dynamic Analysis and its Application to Industrial Processes and Nuclear Power Plant , 1969 .

[9]  Sundaram Seshu,et al.  Fault Isolation in Conventional Linear SystemsߞA Feasibility Study , 1966 .

[10]  L. Bickford,et al.  Frequency response determination using white noise excitation. , 1968 .

[11]  D. R. Towill,et al.  Transfer Function Measurement Using Analog Modeling Techniques , 1973 .

[12]  L. F. Pau,et al.  Applications of pattern recognition to the diagnosis of equipment failures , 1974, Pattern Recognit..

[13]  Y. Funahashi,et al.  Estimation of discrete-time systems using pseudorandom sequences , 1973 .

[14]  Bo Marthinsson,et al.  Automatic Check and Calibration of Digital Voltmeters , 1973 .

[15]  A. S. Weitzenfeld,et al.  Combinatorial Techniques for Fault Identification in Multiterminal Networks , 1967 .

[16]  J. Feldman,et al.  A Laser Gyro Evaluation Plan and Test Results , 1978, Optics & Photonics.

[17]  Harold Stalford,et al.  Identifying an Unknown Process by Utilizing Randomly Chosen Inputs , 1973, Inf. Control..

[18]  Williams R. Wells,et al.  Failure state detection of aircraft engine output sensors , 1977 .

[19]  B. K. Bhagavan,et al.  Evaluating analog-to-digital converters , 1975 .

[20]  R. S. Berkowitz,et al.  Computer Techniques for Solving Electric Circuits for Fault Isolation , 1963, IEEE Transactions on Aerospace.

[21]  R. A. Brown.  Calculator-controlled testing of rate gyroscopes , 1976 .

[22]  U. R. Furst.  Automatic Built-in Test of Advanced Avionics Systems Part II: Design Technioues for Automatic Built-in-Test , 1966, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Warren D. Moon.  Periodic Checkout and Associated Errors , 1964, IEEE Transactions on Aerospace.

[24]  Abdul-Rattaq Habayeb.  System Decomposition, Partitioning, and Integration for Microelectronics , 1968, IEEE Trans. Syst. Sci. Cybern..

[25]  George N. Saridis,et al.  A Pattern Recognition Approach to the Classification of Nonlinear Systems , 1974, IEEE Trans. Syst. Man Cybern..

[26]  Frederic H. Herman,et al.  Incorporation of Statistical Information for Polynomial and Transcendental Interpolation , 1973 .

[27]  R. Saeks,et al.  Fault isolation with insufficient measurements , 1973 .

[28]  J. Hill,et al.  An application of digital computers to linear system identification , 1964 .

[29]  Robert Broen.  A Fault-Tolerant Estimator for Redundant Systems , 1975, IEEE Transactions on Aerospace and Electronic Systems.

[30]  Waldo G. Magnuson,et al.  Bias: A Network Analysis Computer Program Useful to the Reliability Engineer , 1971 .

[31]  T. Trick,et al.  A note on single fault detection in positive resistor circuits , 1978 .

[32]  R. Saeks.  An Approach to Built-In Testing , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[33]  J. E. Valstar.  Some Fundamental Limitations on Indirect Testing of Dynamic Systems , 1966, IEEE Transactions on Aerospace and Electronic Systems.

[34]  D. Towill,et al.  Frequency Domain Fault Detection and Diagnosis in Hybrid Control Systems: A Feasibility Study , 1978, IEEE Transactions on Instrumentation and Measurement.

[35]  D. F. Mix,et al.  Average Correlation Functions in On-Line Testing of Linear Systems , 1973, IEEE Transactions on Aerospace and Electronic Systems.

[36]  D. Sworder,et al.  Influence of sensor failures on LQG regulators , 1977 .

[37]  S. D. Bedrosian.  Analog atpg: a response to users'needs , 1978 .

[38]  Karl Johan Åström,et al.  Numerical Identification of Linear Dynamic Systems from Normal Operating Records , 1965 .

[39]  J. Narraway.  Explicit form for the frequency response determination of rational system functions , 1975 .

[40]  Rein Turn,et al.  SOME ASPECTS OF MAN-COMPUTER COMMUNICATION IN ACTIVE MONITORING OF AUTOMATED CHECKOUT, , 1967 .

[41]  Pieter Eykhoff,et al.  Process parameter and state estimation , 1968, Autom..

[42]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[43]  J. C. Wilcox.  Competitive Evaluation of Failure Detection Algorithms for Strapdown Redundant Inertial Instruments , 1974 .

[44]  R.E. Goodson,et al.  Parameter identification in distributed systems: A synthesizing overview , 1976, Proceedings of the IEEE.

[45]  P. Payne.  An improved technique for transfer function synthesis from frequency response data , 1970 .

[46]  H. B. Kekre.  Determination of linear system parameters by using polynomial inputs , 1968 .

[47]  Alan S. Willsky,et al.  F-8 DFBW sensor failure identification using analytic redundancy , 1977 .

[48]  John Deyst,et al.  Application of likelihood ratio methods to failure detection and identification in the NASA F-8 DFBW aircraft , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[49]  J. Wilcox,et al.  Maximum likelihood failure detection for redundant inertial instruments , 1972 .

[50]  Theodosios Pavlidis,et al.  Signal classification through quasi-singular detection with applications in mechanical fault diagnosis , 1972, IEEE Trans. Inf. Theory.

[51]  L. Mcbride,et al.  A technique for the identification of linear systems , 1965 .

[52]  P.A. Lux,et al.  Fault Detection with a Simple Adaptive Mechanism , 1967, IEEE Transactions on Industrial Electronics and Control Instrumentation.

[53]  K. F. Mcsweeney.  Malfunction Detection System for Advanced Spacecraft , 1966, IEEE Transactions on Aerospace and Electronic Systems.

[54]  David M. Goodman,et al.  Trends in the Development of Automatic Test Equipment, Executive Summary, , 1973 .

[55]  N. N. Puri.  Multi element fault isolation in electronic circuits , 1976 .

[56]  K. Narendra,et al.  An iterative method for the identification of nonlinear systems using a Hammerstein model , 1966 .

[57]  Hyde M. Merrill.  Failure Diagnosis Using Quadratic Programming , 1973 .

[58]  A. Willsky,et al.  A reliable dual-redundant sensor FDI system for the NASA F8C-DFBW aircraft , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[59]  Robert J. Allen.  Failure Prediction Employing Continuous Monitoring Techniques , 1963, IEEE Transactions on Aerospace.

[60]  D. R. Towill.  The engineering of impulse response testing using pseudo-noise stimuli , 1977 .

[61]  J. Kranton,et al.  A Pattern Recognition Approach to Fault Isolation , 1963, IEEE Transactions on Aerospace.

[62]  R. Clark.  A Simplified Instrument Failure Detection Scheme , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[63]  D. R. Towill.  Dynamic testing of control systems , 1977 .

[64]  S. D. Bedrosian.  R64-19 1) The Role of Checkout-Status Control of Weapon Systems , 1964 .

[65]  H. Sriyananda,et al.  Voting Techniques for Fault Diagnosis from Frequency-Domain Test-Data , 1975, IEEE Transactions on Reliability.

[66]  M. Eleccion.  Automatic testing: quality raiser, dollar saver , 1974, IEEE Spectrum.

[67]  K. Steiglitz,et al.  Maximum likelihood estimation of rational transfer function parameters , 1967, IEEE Transactions on Automatic Control.

[68]  R. Mehra.  Identification of stochastic linear dynamic systems , 1969 .

[69]  Sidney I. Firstman,et al.  Optimum Search Routines for Automatic Fault Location , 1960 .

[70]  G. Pretzl.  Dynamic testing of high-speed A/D converters , 1978 .

[71]  J. T. Mash.  Airborne manual/automatic malfunction detection system. , 1968 .

[72]  L. Shieh,et al.  Frequency-variation method for system identification , 1974 .

[73]  Andrew P. Sage,et al.  System Identification , 1971 .

[74]  Wilhelm Schultz.  Measuring and testing with square-wave signals , 1966 .

[75]  Gerald E. Dreifke,et al.  Experimental determination of system dynamics by pulse methods , 1963 .

[76]  Thomas B. Cunningham,et al.  Sensor failure detection using analytical redundancy , 1977 .

[77]  Narindra N. Puri,et al.  Fault Isolation via State Variable Analysis. , 1974 .

[78]  George A. Bekey,et al.  System identification- an introduction and a survey , 1970 .

[79]  James C. Deckert,et al.  Minimax failure detection and identification in redundant gyro and accelerometer systems. , 1973 .

[80]  W. Stahl,et al.  Complete Tree Generation - Some Practical Experience , 1969, IEEE Transactions on Circuit Theory.

[81]  Alan M. Usas.  A Totally Self-Checking Checker Design for the Detection of Errors in Periodic Signals , 1975, IEEE Transactions on Computers.

[82]  James L. Johnson,et al.  ON-BOARD IN-FLIGHT CHECKOUT EVALUATION. , 1968 .

[83]  Carl J. Stehman,et al.  Fault Isolation in Conventional Linear Systems: A Progress Report , 1969 .

[84]  S. E. Williamson,et al.  Use of synchronised dither in pseudorandom-sequence testing , 1973 .

[85]  Harold Lee Jones,et al.  Failure detection in linear systems , 1973 .

[86]  P. Wolff.  Interactive fault isolation of analog hybrid circuit cards , 1978 .

[87]  Adel Attalla Sakla.  Fault Analysis of Analog Circuits , 1979 .

[88]  C. Macleod.  Comparison of methods of parameter estimation using pseudorandom sequences , 1973 .

[89]  Darryl Ray Polk.  On-line checkout of linear dynamic systems by identification , 1974 .

[90]  D. R. Towill,et al.  Predicting servomechanism dynamic errors from frequency response measurements , 1972 .

[91]  D. Towill,et al.  Application of the Multiharmonic Fourier Filter to Nonlinear System Fault Location , 1977, IEEE Transactions on Instrumentation and Measurement.

[92]  Gunter Pretzl.  A New Approach for Testing Ultra Fast A/D-Converters , 1977, ESSCIRC '77: 3rd European Solid State Circuits Conference.

[93]  C. Michel,et al.  Diagnostic Maintenance: A Technique Using a Computer , 1963, IEEE Transactions on Aerospace.

[94]  R. F. Garzia.  COMAD - Application to future manned space vehicles , 1971 .

[95]  J. E. Gibson,et al.  A set of standard specifications for linear automatic control systems , 1961, Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry.

[96]  John Dent.  Diagnostic engineering , 1967, IEEE Spectrum.

[97]  D. R. Towill,et al.  Fault diagnosis using time domain measurements , 1973 .

[98]  Reddy Sn,et al.  Hearing aid testing using pseudo random noise: preliminary results. , 1976 .

[99]  J. O. Flower,et al.  Aspects of the frequency response testing of simple sampled systems , 1971 .

[100]  R. K. Mehra,et al.  Correspondence item: An innovations approach to fault detection and diagnosis in dynamic systems , 1971 .

[101]  A. Lempel,et al.  On a Problem of Diagnosis , 1967, IEEE Transactions on Circuit Theory.

[102]  A.D.G. Hazlerigg,et al.  Application of crosscorrelating equipment to linear-system identification , 1965 .

[103]  Harold T. McAleer.  A look at automatic testing , 1971, IEEE Spectrum.

[104]  C. J. Macleod.  Method of minimising the effect of disturbances on the estimate of the impulse response of a linear system , 1968 .

[105]  E. F. Thomas.  Dc pin-to-pin testing of integrated circuits , 1968 .

[106]  J. Hywel Williams,et al.  Computer aided feature selection for enhanced analogue system fault location , 1978, Pattern Recognit..

[107]  Gerald Jay Sussman,et al.  Heuristic techniques in computer-aided circuit analysis , 1975 .

[108]  G. O. Martens,et al.  Fault Identification in Electronic Circuits with the Aid of Bilinear Transformations , 1972 .

[109]  C. Macleod.  Parameter estimation using pseudorandom binary sequences , 1969 .

[110]  R. S. Berkowitz,et al.  Statistical Considerations in Element Value Solutions , 1962, IRE Transactions on Military Electronics.

[111]  J. Frank Ross,et al.  Automatic Test System for an Analog Computer , 1973 .

[112]  C. Macleod.  System identification using time-weighted pseudorandom sequences† , 1971 .

[113]  J. E. Valstar.  In-Flight Dynamic Checkout , 1963, IEEE Transactions on Aerospace.

[114]  Václav Peterka,et al.  Identification in automatic control systems , 1969, Autom..

[115]  Gustave Shapiro,et al.  Project fist: Fault isolation by semiautomatic techniques: Part II — Detailed instrumentation , 1964, IEEE Spectrum.

[116]  H. A. Barker.  Choice of pseudorandom binary signals for system identification , 1967 .

[117]  Wai-Kai Chen,et al.  On the unique solvability of linear active networks , 1974 .

[118]  R. A. Johnson,et al.  Diagnosis of Equipment Failures , 1960 .

[119]  Yung Ko Chang.  Automatic Test Program Generation. , 1978 .

[120]  S. M. Fisch,et al.  COMPUTER ALGORITHM FOR FAULT ISOLATION AND TEST POINT SELECTION. , 1964 .

[121]  D. R. Towjll,et al.  DEVELOPMENT OF ANALOGUE MODELLING STRATEGIES FOR DYNAMIC PRODUCTION TESTING , 1970 .

[122]  D. R. Towill,et al.  Frequency domain approach to automatic testing of control systems , 1971 .

[123]  Gustave Shapiro,et al.  Project fist: Fault isolation by semiautomatic techniques: Part I — Basic concept and techniques , 1964, IEEE Spectrum.

[124]  Theodosios Pavlidis,et al.  A Segmentation Technique for Waveform Classification , 1972, IEEE Transactions on Computers.

[125]  C. S. Elsden,et al.  A digital transfer function analyser based on pulse rate techniques , 1969, Autom..

[126]  P. K. Giloth,et al.  No. 1 ESS ADF: System testing and early field operation experience , 1970 .

[127]  A.R.M. Noton,et al.  The measurement of control system characteristics by means of a cross-correlator , 1962 .

[128]  J. Lamb.  System frequency response using p-n binary waveforms , 1970 .

[129]  Carl J. Stehman,et al.  DYNAMIC FAULT DIAGNOSIS TECHNIQUES. , 1968 .

[130]  T. Usami,et al.  PRACTICAL APPLICATION OF DIAGNOSTIC SIGNATURE ANALYSIS TO TESTING OF ROTATING MACHINES , 1978 .

[131]  John Deyst,et al.  Adaptive filtering and self-test methods for failure detection and compensation , 1974 .

[132]  Keh-Shew Lu.  Failure Prediction for an On-Line Maintenance System in a Poisson Shock Environment. , 1977 .

[133]  H. Sriyananda.  Application of the method of potential functions to fault diagnosis , 1972 .

[134]  Neeraj Sen.  A measure of testability and its application to test point selection , 1977 .

[135]  P. H. Hammond,et al.  Paper 7: Correlation Analysis of Process Dynamics Using Pseudo-Random Binary Test Perturbations , 1964 .

[136]  S. D. Bedrosian.  A simplified explicit solution of networks with two internal nodes , 1964, IEEE Transactions on Communication and Electronics.

[137]  Robert Lohse,et al.  Vade - A System for Real-Time Space Vehicle Checkout and Launch Monitoring , 1963, IEEE Transactions on Aerospace.

[138]  John G. Bollinger,et al.  Pulse testing in machine tool dynamic analysis , 1965 .

[139]  V. Walton,et al.  Detecting Instrument Malfunctions in Control Systems , 1975, IEEE Transactions on Aerospace and Electronic Systems.

[140]  R. Saeks,et al.  Fault isolation via components simulation , 1972 .

[141]  R. N. Claek.  Instrument Fault Detection , 1978 .

[142]  J. Mash.  An airborne manual/automatic malfunction detection system , 1968 .

[143]  Karl Johan Åström,et al.  BOOK REVIEW SYSTEM IDENTIFICATION , 1994, Econometric Theory.

[144]  G. H. Burgin,et al.  Recent experience with fault diagnosis for analog circuit boards using component failure fimulation , 1978 .

[145]  R. Turn,et al.  The monitoring task in automated checkout of space vehicles , 1965 .

[146]  N. F. McAllister,et al.  An Application of Inverse Probability to Fault Isolation , 1962, IRE Transactions on Military Electronics.

[147]  N. Puri,et al.  Transfer Function Tracking of a Linear Time-Varying System By Means of Auxiliary Simple Lag Networks , 1964, IEEE Transactions on Applications and Industry.

[148]  W. W. Happ,et al.  Programmed test patterns for multiterminal devices , 1969, AFIPS '69 (Spring).

[149]  Gabor C. Temes.  Multiple fault simulation in linear active circuits , 1976 .

[150]  Peter J. Wong.  Application of Decision Theory to the Testing of Large Systems , 1971, IEEE Transactions on Aerospace and Electronic Systems.

[151]  Gerald Jay Sussman,et al.  The virtuous nature of bugs , 1974 .

[152]  R Saeks,et al.  Fault Analysis in Electronic Circuits and Systems. II. , 1978 .

[153]  W. Hankley,et al.  A Pattern Recognition Technique for System Error Analysis , 1971 .

[154]  L. Gefferth.  Fault identification in resistive and reactive networks , 1974 .

[155]  A. A. Wolf,et al.  A statistical theory for parameter identification in physical systems , 1962 .