Fault detection in autonomous robots

In this dissertation, we study two new approaches to fault detection for autonomous robots. The first approach involves the synthesis of software components that give a robot the capacity to detect faults which occur in itself. Our hypothesis is that hardware faults change the flow of sensory data and the actions performed by the control program. By detecting these changes, the presence of faults can be inferred. In order to test our hypothesis, we collect data in three different tasks performed by real robots. During a number of training runs, we record sensory data from the robots both while they are operating normally and after a fault has been injected. We use back-propagation neural networks to synthesize fault detection components based on the data collected in the training runs. We evaluate the performance of the trained fault detectors in terms of the number of false positives and the time it takes to detect a fault.The results show that good fault detectors can be obtained. We extend the set of possible faults and go on to show that a single fault detector can be trained to detect several faults in both a robot's sensors and actuators. We show that fault detectors can be synthesized that are robust to variations in the task. Finally, we show how a fault detector can be trained to allow one robot to detect faults that occur in another robot.The second approach involves the use of firefly-inspired synchronization to allow the presence of faulty robots to be determined by other non-faulty robots in a swarm robotic system. We take inspiration from the synchronized flashing behavior observed in some species of fireflies. Each robot flashes by lighting up its on-board red LEDs and neighboring robots are driven to flash in synchrony. The robots always interpret the absence of flashing by a particular robot as an indication that the robot has a fault. A faulty robot can stop flashing periodically for one of two reasons. The fault itself can render the robot unable to flash periodically.Alternatively, the faulty robot might be able to detect the fault itself using endogenous fault detection and decide to stop flashing.Thus, catastrophic faults in a robot can be directly detected by its peers, while the presence of less serious faults can be detected by the faulty robot itself, and actively communicated to neighboring robots. We explore the performance of the proposed algorithm both on a real world swarm robotic system and in simulation. We show that failed robots are detected correctly and in a timely manner, and we show that a system composed of robots with simulated self-repair capabilities can survive relatively high failure rates.We conclude that i) fault injection and learning can give robots the capacity to detect faults that occur in themselves, and that ii) firefly-inspired synchronization can enable robots in a swarm robotic system to detect and communicate faults.

[1]  Toshio Fukuda,et al.  Cell Structured robotic system CEBOT: Control, planning and communication methods , 1991, Robotics Auton. Syst..

[2]  Jean Arlat,et al.  Fault Injection for Dependability Validation: A Methodology and Some Applications , 1990, IEEE Trans. Software Eng..

[3]  Marco Dorigo,et al.  Autonomous Self-Assembly in Swarm-Bots , 2006, IEEE Transactions on Robotics.

[4]  Charles S. Peskin,et al.  Mathematical aspects of heart physiology , 1975 .

[5]  Anders Lyhne Christensen,et al.  SWARMORPH: Morphology Control with a Swarm of Self-Assembling Robots , 2007 .

[6]  Anna Kochan A bumper year for robots , 2005, Ind. Robot.

[7]  V. Verma,et al.  Real-time fault detection and situational awareness for rovers: report on the Mars technology program task , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[8]  Martin Nilsson,et al.  Cooperative multi-robot box-pushing , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[9]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[10]  Robin R. Murphy,et al.  Follow-up analysis of mobile robot failures , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  James McLurkin,et al.  Distributed Algorithms for Dispersion in Indoor Environments Using a Swarm of Autonomous Mobile Robots , 2004, DARS.

[12]  S. Strogatz,et al.  Synchronization of pulse-coupled biological oscillators , 1990 .

[13]  Maja J. Mataric,et al.  Pusher-watcher: an approach to fault-tolerant tightly-coupled robot coordination , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[14]  Shigeo Hirose,et al.  Proposal for cooperative robot "Gunryu" composed of autonomous segments , 1996, Robotics Auton. Syst..

[15]  Marco Dorigo,et al.  Object transport by modular robots that self-assemble , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Marco Dorigo,et al.  Group Transport Along a Robot Chain in a Self-Organised Robot Colony , 2006, IAS.

[17]  Luca Maria Gambardella,et al.  The cooperation of swarm-bots: physical interactions in collective robotics , 2005, IEEE Robotics & Automation Magazine.

[18]  Anders Lyhne Christensen,et al.  Self-sssembly and morphology control in a swarm-bot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[20]  Walter Truszkowski,et al.  NASA's Swarm Missions: The Challenge of Building Autonomous Software , 2004, IT Prof..

[21]  Anders Lyhne Christensen,et al.  A Mechanism to Self-Assemble Patterns with Autonomous Robots , 2007, ECAL.

[22]  Janos Gertler,et al.  Fault detection and diagnosis in engineering systems , 1998 .

[23]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[24]  Marco Dorigo,et al.  Cooperation through self-assembling in multi-robot systems , 2005 .

[25]  Marco Dorigo,et al.  Evolution of Direct Communication for a Swarm-bot Performing Hole Avoidance , 2004, ANTS Workshop.

[26]  Francesco Mondada,et al.  Self-assembly on Demand in a Group of Physical Autonomous Mobile Robots Navigating Rough Terrain , 2005, ECAL.

[27]  Anders Lyhne Christensen,et al.  SWARMORPH: Multirobot Morphogenesis Using Directional Self-Assembly , 2009, IEEE Transactions on Robotics.

[28]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[29]  Sebastian Thrun,et al.  Real-time fault diagnosis [robot fault diagnosis] , 2004, IEEE Robotics & Automation Magazine.

[30]  Marco Dorigo,et al.  Evolution of Solitary and Group Transport Behaviors for Autonomous Robots Capable of Self-Assembling , 2008, Adapt. Behav..

[31]  Renato Tinós,et al.  Fault detection and isolation in robotic manipulators via neural networks: A comparison among three architectures for residual analysis , 2001, J. Field Robotics.

[32]  Yoshio Kawauchi,et al.  A principle of distributed decision making of Cellular Robotic System (CEBOT) , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[33]  T. Vicsek,et al.  Self-organizing processes: The sound of many hands clapping , 2000, Nature.

[34]  Stephen R. Marsland,et al.  On-line novelty detection for autonomous mobile robots , 2005, Robotics Auton. Syst..

[35]  Masaki Yamakita,et al.  Analysis of formation control of cooperative transportation of mother ship by SMC , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[36]  Shigeo Hirose,et al.  Study of Super-Mechano Colony: concept and basic experimental set-up , 2001, Adv. Robotics.

[37]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[38]  Hugh F. Durrant-Whyte,et al.  Mobile robot localization by tracking geometric beacons , 1991, IEEE Trans. Robotics Autom..

[39]  N. Bartelt,et al.  Identifying the forces responsible for self-organization of nanostructures at crystal surfaces , 1999, Nature.

[40]  R. J. Patton,et al.  Soft Computing Approaches to Fault Diagnosis for Dynamic Systems: A Survey , 2000 .

[41]  Kasper Støy,et al.  Using Situated Communication in Distributed Autonomous Mobile Robotics , 2001, SCAI.

[42]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[43]  Anders Lyhne Christensen,et al.  SWARMORPH-script: a language for arbitrary morphology generation in self-assembling robots , 2008, Swarm Intelligence.

[44]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[45]  Bill Gates,et al.  A robot in every home. , 2007 .

[46]  Raymond C. Kurzweil,et al.  The Singularity Is Near , 2018, The Infinite Desire for Growth.

[47]  L. Glass Synchronization and rhythmic processes in physiology , 2001, Nature.

[48]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[49]  J.J. Gertler,et al.  Survey of model-based failure detection and isolation in complex plants , 1988, IEEE Control Systems Magazine.

[50]  Marios M. Polycarpou,et al.  Neural-network-based robust fault diagnosis in robotic systems , 1997, IEEE Trans. Neural Networks.

[51]  I-Jeng Wang,et al.  Decentralized synchronization protocols with nearest neighbor communication , 2004, SenSys '04.

[52]  Heinz Wörn,et al.  The I-SWARM project , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[53]  Marco Dorigo,et al.  Self-Assembly in Physical Autonomous Robots - the Evolutionary Robotics Approach , 2008, ALIFE.

[54]  Thomas P. Minka,et al.  Gates , 2008, NIPS.

[55]  Francesco Mondada,et al.  Mobile Robot Miniaturisation: A Tool for Investigation in Control Algorithms , 1993, ISER.

[56]  D. E. Rumelhart,et al.  Learning internal representations by back-propagating errors , 1986 .

[57]  Alan F. T. Winfield,et al.  Safety in numbers: fault-tolerance in robot swarms , 2006, Int. J. Model. Identif. Control..

[58]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[59]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[60]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[61]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[62]  Wei-Min Shen,et al.  CONRO: Towards Deployable Robots with Inter-Robots Metamorphic Capabilities , 2000, Auton. Robots.

[63]  Nick Jakobi,et al.  Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis , 1997, Adapt. Behav..

[64]  Rolf Isermann,et al.  Supervision, fault-detection and fault-diagnosis methods — An introduction , 1997 .

[65]  Hiroaki Kitano,et al.  Vision, Strategy, and Localization Using the Sony Robots at RoboCup-98 , 2000, AI Mag..

[66]  Gautam Biswas,et al.  Bayesian Fault Detection and Diagnosis in Dynamic Systems , 2000, AAAI/IAAI.

[67]  Gaurav S. Sukhatme,et al.  Fault detection and identification in a mobile robot using multiple model estimation and neural network , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[68]  Deborah Estrin,et al.  Time synchronization for wireless sensor networks , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[69]  Wei-Min Shen,et al.  Hormone-Inspired Self-Organization and Distributed Control of Robotic Swarms , 2004, Auton. Robots.

[70]  Stefano Nolfi,et al.  Evolving mobile robots in simulated and real environments , 1995 .

[71]  E. Bonabeau,et al.  Self-organization in social insects. , 1997, Trends in ecology & evolution.

[72]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[73]  Marco Dorigo,et al.  Self-Assembly at the Macroscopic Scale , 2008, Proceedings of the IEEE.

[74]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[75]  M. McClintock,et al.  Menstrual Synchrony and Suppression , 1971, Nature.

[76]  Alan S. Perelson,et al.  Self-nonself discrimination in a computer , 1994, Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy.

[77]  T. Misteli The concept of self-organization in cellular architecture , 2001, The Journal of cell biology.

[78]  Marco Dorigo,et al.  Self-organisation and communication in groups of simulated and physical robots , 2006, Biological Cybernetics.

[79]  I. Roman-Ballesteros,et al.  A Framework for Cooperative Multi-Robot Surveillance Tasks , 2006, Electronics, Robotics and Automotive Mechanics Conference (CERMA'06).

[80]  Anthony Stentz,et al.  Robust multirobot coordination in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[81]  Heinz Wörn,et al.  The I-SWARM Project: Intelligent Small World Autonomous Robots for Micro-manipulation , 2004, Swarm Robotics.

[82]  Lynne E. Parker,et al.  Sensor Analysis for Fault Detection in Tightly-Coupled Multi-Robot Team Tasks , 2007, ICRA.