Fault detection algorithms for spacecraft monitoring and environmental sensing

Constellations of hundreds of low-Earth orbiting small satellites are currently being designed and built. Operators plan to provide data and media distribution services as well as imaging and weather observations. As our society increases its dependence on satellite services for communication and navigation, there is a growing need for efficient spacecraft systems monitoring and space situational awareness to avoid service interruptions due to hazards such as space weather. Particularly for large constellations, satellites need greater autonomy to improve responsivity and reduce the load on human operators. In this thesis, we present the development of algorithms that identify unusual behavior in satellite health telemetry. Once these events have been identified, we collect and analyze them, along with assessing space weather observations and operational environment factors. Our approach uses transient event detection and change-point event detection techniques, statistically evaluating the telemetry stream compared to a local norm. This approach allows us to apply our algorithms to any spacecraft platform, since there is no reliance on satellite- or component-specific parameters, and it does not require a priori knowledge about the data distribution. We apply these techniques to individual telemetry data streams on geostationary Earth orbit (GEO) communications satellites (ComSats), and consider the results, a compiled list of unusual events for each satellite. Results include being able to identify events that affect many telemetry streams at once, indicative of a spacecraft system-level event. With data from multiple satellites, we can use these methods to better determine whether external factors played a role. We compare event dates to known operational activities and to known space weather events to assess the use of event detection algorithms for spacecraft monitoring and for environmental sensing.

[1]  Eamonn Keogh Mining Time Series Data , 2005 .

[2]  Franklin E White,et al.  Data Fusion Lexicon , 1991 .

[3]  Ernie Tretkoff Space Weather and Satellite Engineering: An Interview With Michael Bodeau , 2010 .

[4]  Whitney Quinne Lohmeyer,et al.  Data management of geostationary communication satellite telemetry and correlation to space weather observations , 2013 .

[5]  Sanjay Chawla,et al.  Mining for Outliers in Sequential Databases , 2006, SDM.

[6]  Takehisa Yairi,et al.  An approach to spacecraft anomaly detection problem using kernel feature space , 2005, KDD '05.

[7]  B. Abraham,et al.  Outlier detection and time series modeling , 1989 .

[8]  Dorothy E. Denning,et al.  An Intrusion-Detection Model , 1986, 1986 IEEE Symposium on Security and Privacy.

[9]  Edward W. Cliver,et al.  Revisiting the Sunspot Number , 2014, Space Science Reviews.

[10]  J. R. Srour,et al.  Radiation effects on microelectronics in space , 1988, Proc. IEEE.

[11]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[12]  Harlan E. Spence,et al.  The Relativistic Electron-Proton Telescope (REPT) Instrument on Board the Radiation Belt Storm Probes (RBSP) Spacecraft: Characterization of Earth’s Radiation Belt High-Energy Particle Populations , 2013 .

[13]  Silvio Simani,et al.  Fault Detection and Diagnosis for Aeronautic and Aerospace Missions , 2010 .

[14]  P. Riley On the probability of occurrence of extreme space weather events , 2012 .

[15]  X. Shao,et al.  Simultaneous Wavelength Selection and Outlier Detection in Multivariate Regression of Near-Infrared Spectra , 2005, Analytical sciences : the international journal of the Japan Society for Analytical Chemistry.

[16]  R. Pease Total-dose issues for microelectronics in space systems , 1996 .

[17]  Eamonn J. Keogh,et al.  An Enhanced Representation of Time Series Which Allows Fast and Accurate Classification, Clustering and Relevance Feedback , 1998, KDD.

[18]  Eamonn J. Keogh,et al.  Autocannibalistic and Anyspace Indexing Algorithms with Application to Sensor Data Mining , 2009, SDM.

[19]  D. Baker The occurrence of operational anomalies in spacecraft and their relationship to space weather , 2000 .

[20]  Carlos Agón,et al.  Time-series data mining , 2012, CSUR.

[22]  John P. W. Stark,et al.  Spacecraft systems engineering , 1995 .

[23]  Shai Ben-David,et al.  Detecting Change in Data Streams , 2004, VLDB.

[24]  James R. Wertz,et al.  Space mission engineering : the new SMAD , 2011 .

[25]  S. Lai Fundamentals of Spacecraft Charging: Spacecraft Interactions with Space Plasmas , 2011 .

[26]  Eric Ronald Priest,et al.  Magnetic Reconnection: MHD Theory and Applications , 2000 .

[27]  D. Baker,et al.  Energetic electrons, 50 keV to 6 MeV, at geosynchronous orbit: Their responses to solar wind variations , 2005 .

[28]  Vir V. Phoha,et al.  Internet Security Dictionary , 2002, Springer New York.

[29]  Eleazar Eskin,et al.  Anomaly Detection over Noisy Data using Learned Probability Distributions , 2000, ICML.

[30]  Wilson Wong,et al.  Military space power : a guide to the issues , 2010 .

[31]  Eamonn J. Keogh,et al.  Finding the most unusual time series subsequence: algorithms and applications , 2006, Knowledge and Information Systems.

[32]  Massimo Tipaldi,et al.  Spacecraft health monitoring and management systems , 2014, 2014 IEEE Metrology for Aerospace (MetroAeroSpace).

[33]  Eamonn J. Keogh,et al.  Approximations to magic: finding unusual medical time series , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[34]  Thanvarat Komviriyavut,et al.  Network intrusion detection and classification with Decision Tree and rule based approaches , 2009, 2009 9th International Symposium on Communications and Information Technology.

[35]  Michael Kearns,et al.  Computational complexity of machine learning , 1990, ACM distinguished dissertations.

[36]  P. S. Avadhani,et al.  A comparison of data mining techniques for intrusion detection , 2012, 2012 IEEE International Conference on Advanced Communication Control and Computing Technologies (ICACCCT).

[37]  J. Borovsky,et al.  Differences between CME‐driven storms and CIR‐driven storms , 2006 .

[38]  Brett Hemenway,et al.  Satellite Anomalies: Benefits of a Centralized Anomaly Database and Methods for Securely Sharing Information Among Satellite Operators , 2014 .

[39]  James V. Candy,et al.  Bayesian Signal Processing: Classical, Modern and Particle Filtering Methods , 2009 .

[40]  Paul A. Abell,et al.  NASA's Asteroid Redirect Mission (ARM) , 2015 .

[41]  James I. Vette,et al.  The AE-8 trapped electron model environment , 1991 .

[42]  Lucas C. Parra,et al.  Statistical Independence and Novelty Detection with Information Preserving Nonlinear Maps , 1996, Neural Computation.

[43]  J. Diehl,et al.  Reducing the cost of spacecraft ground systems and operations , 2003 .

[44]  J. I. Vette,et al.  Ap-8 trapped proton environment for solar maximum and solar minimum. [AP8MAX and AP8MIN] , 1976 .

[45]  D. Baker How to Cope with Space Weather , 2002, Science.

[46]  Steven B. Smith,et al.  Digital Signal Processing: A Practical Guide for Engineers and Scientists , 2002 .

[47]  Henry B. Garrett,et al.  Guide to Mitigating Spacecraft Charging Effects: Garrett/Charging Effects , 2012 .

[48]  R. Pease,et al.  The Effects of ELDRS at Ultra-Low Dose Rates , 2010, 2010 IEEE Radiation Effects Data Workshop.

[49]  Eamonn J. Keogh,et al.  Segmenting Time Series: A Survey and Novel Approach , 2002 .

[50]  G. P. Ginet,et al.  AE9, AP9 and SPM: New Models for Specifying the Trapped Energetic Particle and Space Plasma Environment , 2013 .

[51]  Axel Schulte,et al.  Human-UAV Co-operation Based on Artificial Cognition , 2009, HCI.

[52]  Martin Meckesheimer,et al.  Automatic outlier detection for time series: an application to sensor data , 2007, Knowledge and Information Systems.

[53]  Philip Chan,et al.  Learning States and Rules for Time Series Anomaly Detection , 2004, FLAIRS.

[54]  Martin G. Buehler,et al.  Integrated environmental monitoring system for spacecraft , 1995 .

[55]  Graham J. Williams,et al.  On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms , 2000, KDD '00.

[56]  David R. Chesney,et al.  Space Weather Modeling Framework: A new tool for the space science community , 2005, Journal of Geophysical Research.

[57]  G. Kopp,et al.  A new, lower value of total solar irradiance: Evidence and climate significance , 2011 .

[58]  Gerhard Drolshagen,et al.  Space Environment Analysis: Experience and Trends , 1996 .

[59]  W. Hess The effects of high-altitude explosions , 1964 .

[60]  Yanchun Liang,et al.  Non-Parametric Change-Point Method for Differential Gene Expression Detection , 2011, PloS one.

[61]  Dennis Roddy,et al.  Satellite Communications , 1989 .

[62]  Mooi Choo Chuah,et al.  ECG Anomaly Detection via Time Series Analysis , 2007, ISPA Workshops.

[63]  Whitney Quinne Lohmeyer,et al.  Space radiation environment impacts on high power amplifiers and solar cells on-board geostationary communications satellites , 2015 .

[64]  A. R. Frederickson,et al.  Upsets related to spacecraft charging , 1996 .

[65]  Michèle Lavagna,et al.  SMART-FDIR: Use of Artificial Intelligence in the Implementation of a Satellite FDIR , 2003 .

[66]  Robert Lund,et al.  A Review and Comparison of Changepoint Detection Techniques for Climate Data , 2007 .

[67]  Vanish Talwar,et al.  Statistical techniques for online anomaly detection in data centers , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[68]  J. R. Schwank,et al.  Radiation Hardness Assurance Testing of Microelectronic Devices and Integrated Circuits: Radiation Environments, Physical Mechanisms, and Foundations for Hardness Assurance , 2013, IEEE Transactions on Nuclear Science.

[69]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[70]  Raymond J. Mooney,et al.  A probabilistic framework for semi-supervised clustering , 2004, KDD.

[71]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[72]  Barak A. Pearlmutter,et al.  Detecting intrusions using system calls: alternative data models , 1999, Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344).

[73]  D. C. Wilkinson,et al.  TDRS-1 single event upsets and the effect of the space environment , 1991 .

[74]  Julien Marzat,et al.  Model-based fault diagnosis for aerospace systems: a survey , 2012 .

[75]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[76]  J. Blake,et al.  Spacecraft Charging: Observations and Relationship to Satellite Anomalies , 2001 .

[77]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[78]  Hagit Shatkay,et al.  Approximate queries and representations for large data sequences , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[79]  Eamonn J. Keogh,et al.  Finding surprising patterns in a time series database in linear time and space , 2002, KDD.

[80]  A. Wander,et al.  Innovative Fault Detection, Isolation and Recovery Strategies On-Board Spacecraft: State of the Art and Research Challenges , 2013 .

[81]  Tom Fawcett,et al.  Activity monitoring: noticing interesting changes in behavior , 1999, KDD '99.

[82]  Yoshinobu Kawahara,et al.  Adaptive Limit Checking for Spacecraft Telemetry Data Using Kernel Principal Component Analysis , 2009 .

[83]  D. Hastings,et al.  Spacecraft–Environment Interactions: Index , 1996 .

[84]  Carolus J. Schrijver,et al.  Socio‐Economic Hazards and Impacts of Space Weather: The Important Range Between Mild and Extreme , 2015, 1507.08730.

[85]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[86]  Bryan L. Benedict Investing in Satellite Life Extension - Fleet Planning Options for Spacecraft Owner/Operators , 2014 .

[87]  E. V. Benton,et al.  Space radiation dosimetry in low-Earth orbit and beyond. , 2001, Nuclear instruments & methods in physics research. Section B, Beam interactions with materials and atoms.

[88]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[89]  R. Kataoka,et al.  Flux enhancement of the outer radiation belt electrons after the arrival of stream interaction regions , 2008 .

[90]  Michael Bodeau High Energy Electron Climatology that Supports Deep Charging Risk Assessment in GEO , 2010 .

[91]  G. Reeves,et al.  Long‐term variations in solar wind velocity and radiation belt electrons , 2013 .

[92]  Ashok N. Srivastava,et al.  Nonlinear gated experts for time series: discovering regimes and avoiding overfitting , 1995, Int. J. Neural Syst..

[93]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[94]  Paula S. Morgan Fault protection techniques in JPL Spacecraft , 2005 .

[95]  H. Spence,et al.  CRaTER: The Cosmic Ray Telescope for the Effects of Radiation Experiment on the Lunar Reconnaissance Orbiter Mission , 2010 .

[96]  G. Wrenn Conclusive evidence for internal dielectric charging anomalies on geosynchronous communications spacecraft , 1995 .

[97]  Ana Bianco,et al.  Outlier Detection in Regression Models with ARIMA Errors Using Robust Estimates , 2001 .

[98]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[99]  Kerri Cahoy,et al.  Response of geostationary communications satellite solid‐state power amplifiers to high‐energy electron fluence , 2015 .

[100]  F. Massey The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[101]  B. Tsurutani,et al.  Large amplitude IMF fluctuations in corotating interaction regions: Ulysses at midlatitudes , 1995 .

[102]  Hillol Kargupta,et al.  Energy Consumption in Data Analysis for On-board and Distributed Applications , 2003 .

[103]  Salvatore J. Stolfo,et al.  Modeling system calls for intrusion detection with dynamic window sizes , 2001, Proceedings DARPA Information Survivability Conference and Exposition II. DISCEX'01.

[104]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[105]  Richard I. Abbot,et al.  Decision Support in Space Situational Awareness , 2007 .

[106]  G. Box,et al.  Bayesian analysis of some outlier problems in time series , 1979 .