Sensing Assessment in Unknown Environments: A Survey

This paper surveys sensing assessment solutions from the literature with a particular focus on techniques which can be used in unknown environments, including the following: sensor fault detection and identification (FDI), sensor or source evaluation, and isolating poorly sensed regions. Each approach is evaluated in terms of its ability to perform sensing assessment tasks in unknown environments and its coverage of the range of potential sensing problems. These tasks include sensing problem detection and characterization, as well as performance evaluation (e.g., estimating accuracy or reliability), for a sensor or group of sensors. This survey shows that over 40 existing approaches are focused on either detection and identification of traditional sensor faults (e.g., drift or physical damage) in known environments or evaluation of the reliability of a source (e.g., sensor or agent). Only eight approaches surveyed have tackled environment-dependent problems (e.g., exteroceptive sensor FDI, miscalibration, or use of an inappropriate sensor) in a useful manner for unknown environments. Even less work (two studies) appears to have been done on isolating poorly sensed regions. The survey concludes with a list of opportunities for future research, including developing methods for detecting and characterizing environment-dependent problems and creating comprehensive sensing assessment systems.

[1]  Chrissanthi Angeli,et al.  On-Line Fault Detection Techniques for Technical Systems: A Survey , 2004, Int. J. Comput. Sci. Appl..

[2]  Donald L. Simon,et al.  Hybrid Kalman Filter Approach for Aircraft Engine In-Flight Diagnostics: Sensor Fault Detection Case , 2007 .

[3]  Guillermo Heredia,et al.  Sensor and actuator fault detection in small autonomous helicopters , 2008 .

[4]  Marilena Vendittelli,et al.  The transferable belief model in ultrasonic map building , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[5]  Jordi Sabater-Mir,et al.  Reputation and social network analysis in multi-agent systems , 2002, AAMAS '02.

[6]  Peter Xiaoping Liu,et al.  Multiple sensor data fusion in robotic prosthetic eye system , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[7]  J. Torin,et al.  Redundancy management in distributed flight control systems: experience & simulations , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[8]  Gaurav S. Sukhatme,et al.  Sensor fault detection and identification in a mobile robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[9]  Tharam S. Dillon,et al.  Fuzzy trust evaluation and credibility development in multi-agent systems , 2007, Appl. Soft Comput..

[10]  Alfonso F. Cardenas,et al.  Data quality inference , 2005, IQIS '05.

[11]  S. Challa,et al.  Can we trust trusted nodes in wireless sensor networks? , 2008, 2008 International Conference on Computer and Communication Engineering.

[12]  P. Pandurang Nayak,et al.  A Model-Based Approach to Reactive Self-Configuring Systems , 1996, AAAI/IAAI, Vol. 2.

[13]  Dai Hongjun,et al.  An Entropy-based Trust Modeling and Evaluation for Wireless Sensor Networks , 2008, ICESS.

[14]  Zixing Cai,et al.  Fault Diagnosis and Fault Tolerant Control for Wheeled Mobile Robots under Unknown Environments: A Survey , 2005, IEEE International Conference on Robotics and Automation.

[15]  Yael Edan,et al.  An adaptive fuzzy-logic procedure for ranking logical sensory performance , 2002, Proceedings of IEEE Sensors.

[16]  Aldo Franco Dragoni,et al.  Distributed Belief Revision , 2004, Autonomous Agents and Multi-Agent Systems.

[17]  Robin R. Murphy,et al.  Use of Dempster-Shafer Conflict Metric to Detect Interpretation Inconsistency , 2005, UAI.

[18]  Ola Pettersson,et al.  Execution monitoring in robotics: A survey , 2005, Robotics Auton. Syst..

[19]  Vladimir J. Lumelsky,et al.  Fault tolerance via analytic redundancy for a modularized sensitive skin , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[20]  M. Saif,et al.  Adaptive Sensor Fault Detection and Isolation in Uncertain Systems , 2007, 2007 American Control Conference.

[21]  N. Ranganathan,et al.  An intelligent system for failure detection and control in an autonomous underwater vehicle , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[22]  Sriram Narasimhan,et al.  Combining Particle Filters and Consistency-Based Approaches for Monitoring and Diagnosis of Stochastic Hybrid Systems , 2004 .

[23]  Hanumant Singh,et al.  Consistency based error evaluation for deep sea bathymetric mapping with robotic vehicles , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Mani B. Srivastava,et al.  Reputation-based framework for high integrity sensor networks , 2004, SASN '04.

[25]  Gaurav S. Sukhatme,et al.  Fault detection and identification in a mobile robot using multiple model estimation and neural network , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  F.W. Fuchs,et al.  Voltage Sensor Fault Detection and Reconfiguration for a Doubly Fed Induction Generator , 2007, 2007 IEEE International Symposium on Diagnostics for Electric Machines, Power Electronics and Drives.

[27]  C. L. Philip Chen,et al.  Adaptive Sensor Fault Detection and Identification Using Particle Filter Algorithms , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Yi Shen,et al.  A new method for sensor fault detection, isolation and accommodation , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[29]  K. Suzanne Barber,et al.  Soft Security: Isolating Unreliable Agents from Society , 2002, Trust, Reputation, and Security.

[30]  Nicholas R. Jennings,et al.  An integrated trust and reputation model for open multi-agent systems , 2006, Autonomous Agents and Multi-Agent Systems.

[31]  Hod Lipson,et al.  Automated damage diagnosis and recovery for remote robotics , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[32]  Yong Ping Xu,et al.  A multi-sensor based temperature measuring system with self-diagnosis , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[33]  Galina L. Rogova,et al.  Reliability In Information Fusion : Literature Survey , 2004 .

[34]  Steven Reece,et al.  A Multi-Dimensional Trust Model for Heterogeneous Contract Observations , 2007, AAAI.

[35]  K. Suzanne Barber,et al.  Belief Revision Process Based on Trust: Agents Evaluating Reputation of Information Sources , 2000, Trust in Cyber-societies.

[36]  Nicholas R. Jennings,et al.  TRAVOS: Trust and Reputation in the Context of Inaccurate Information Sources , 2006, Autonomous Agents and Multi-Agent Systems.

[37]  Munindar P. Singh,et al.  Detecting deception in reputation management , 2003, AAMAS '03.

[38]  Qing Zhao,et al.  LMI-based sensor fault diagnosis for nonlinear Lipschitz systems , 2007, Autom..

[39]  Ben Motazed,et al.  Application of fault-tolerant controls to UAVs , 1996, Defense, Security, and Sensing.

[40]  Richard Washington,et al.  On-board real-time state and fault identification for rovers , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[41]  Zhimin Du,et al.  Detection and diagnosis for sensor fault in HVAC systems , 2007 .

[42]  Hajime Asama,et al.  A system for self-diagnosis of an autonomous mobile robot using an internal state sensory system: fault detection and coping with the internal condition , 2003, Adv. Robotics.

[43]  Mauro Birattari,et al.  Fault detection in autonomous robots based on fault injection and learning , 2008, Auton. Robots.

[44]  J. C. Gerdes,et al.  A probabilistic approach to residual processing for vehicle fault detection , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[45]  S. Sitharama Iyengar,et al.  Distributed Bayesian algorithms for fault-tolerant event region detection in wireless sensor networks , 2004, IEEE Transactions on Computers.

[46]  Giampiero Campa,et al.  Minimal resource allocating networks for aircraft SFDIA , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[47]  Levi B. Larkey,et al.  In-Situ Data Quality Assurance for Environmental Applications of Wireless Sensor Networks , 2006 .

[48]  Hyunsoo Yoon,et al.  Trust Management for Resilient Wireless Sensor Networks , 2005, ICISC.

[49]  Qi Han,et al.  Journal of Network and Systems Management ( c ○ 2007) DOI: 10.1007/s10922-007-9062-0 A Survey of Fault Management in Wireless Sensor Networks , 2022 .

[50]  Luís Seabra Lopes,et al.  Sentience in Robots: Applications and Challenges , 2001, IEEE Intell. Syst..

[51]  Jiazhen Wang,et al.  A Trust Evaluation Method of Mobile Agent System , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[52]  Wolfram Burgard,et al.  Efficient Failure Detection on Mobile Robots Using Particle Filters with Gaussian Process Proposals , 2007, IJCAI.

[53]  Martin Brown,et al.  Simultaneous, Multiplicative Actuator and Sensor Fault Estimation using Fuzzy Observers , 2007, 2007 IEEE International Fuzzy Systems Conference.

[54]  Zixing Cai,et al.  Fuzzy Adaptive Particle Filter Algorithm for Mobile Robot Fault Diagnosis , 2006, ICONIP.

[55]  M. Hashimoto,et al.  Sensor fault detection and isolation for a powered wheelchair , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[56]  Huafeng Wu,et al.  Agent-Based Trust Management Model for Wireless Sensor Networks , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[57]  C. L. Philip Chen,et al.  Particle filtering for adaptive sensor fault detection and identification , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[58]  Martin Soika.  A sensor failure detection framework for autonomous mobile robots , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[59]  Suresh M. Joshi,et al.  Reconfigurable NDI controller using inertial sensor failure detection & isolation , 2001 .

[60]  Munindar P. Singh,et al.  An evidential model of distributed reputation management , 2002, AAMAS '02.

[61]  Sauro Longhi,et al.  Model-Based Sensor Fault Detection and Isolation System for Unmanned Ground Vehicles: Theoretical Aspects (part I) , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[62]  Roberto Kawakami Harrop Galvão,et al.  A Wavelet Band-Limiting Filter Approach for Fault Detection in Dynamic Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[63]  Antonis A. Argyros,et al.  Fusion of laser and visual data for robot motion planning and collision avoidance , 2003, Machine Vision and Applications.

[64]  M. Potkonjak,et al.  Markov chain-based models for missing and faulty data in MICA2 sensor motes , 2005, IEEE Sensors, 2005..

[65]  D. Bank.  An error detection model for ultrasonic sensor evaluation on autonomous mobile systems , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[66]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[67]  B. Clifford Neuman,et al.  Trust based Approach for Improving Data Reliability in Industrial Sensor Networks , 2007, IFIPTM.

[68]  Andrew M. Tyrrell,et al.  Robot error detection using an artificial immune system , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[69]  Martin Soika,et al.  Grid based fault detection and calibration of sensors on mobile robots , 1997, Proceedings of International Conference on Robotics and Automation.

[70]  Keith J. Burnham,et al.  Improved SI engine modelling techniques with application to fault detection , 2002, Proceedings of the International Conference on Control Applications.

[71]  Zhiwei Gao,et al.  Reliable Observer-Based Control Against Sensor Failures for Systems With Time Delays in Both State and Input , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[72]  Zhu Han,et al.  Information theoretic framework of trust modeling and evaluation for ad hoc networks , 2006, IEEE Journal on Selected Areas in Communications.

[73]  Jamal Bentahar,et al.  An approach to comprehensive trust management in multi-agent systems with credibility , 2008, 2008 Second International Conference on Research Challenges in Information Science.

[74]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[75]  M. Perrier,et al.  Fault-diagnosis of subsea robots using neuro-symbolic hybrid systems , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).