FT-AVS: a Fault-tolerant Architecture for Real-Time Active Vision

The nature of most problems addressed by robotics requires that robotic systems possess real-time properties. Additionally, as a result of steady increases in power and decreases in the cost of technology, it has become feasible to integrate sophisticated vision systems into robotic tasks. This can be seen by the recent interest in active vision.The purpose of this paper is two-fold: we first present a novel architecture for real-time active vision systems, and then enhance the architecture with a unified approach to fault tolerance. Our system is designed modularly in order to enable the flexible addition of hardware and software redundancy and also to allow reconfiguration when and where needed. This gives us the ability to handle faults in the context of active vision. Further, the distribution of software on the available hardware is such that users can utilize a dual-model of execution (simulation and rapid prototyping). Lastly, the tests we ran on the implemented architecture in order to validate the results of the experimentation and simulations show a good correlation of parameters.

[1]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[2]  P. D. Roberts Computer Control of Real-Time Processes , 1991 .

[3]  Eric C. Cooper Replicated distributed programs , 1985, SOSP '85.

[4]  James L. Crowley,et al.  Vision as Process , 1995 .

[5]  Chung Laung Liu,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[6]  James J. Clark,et al.  Modal Control Of An Attentive Vision System , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[7]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[8]  Algirdas Avizienis,et al.  The N-Version Approach to Fault-Tolerant Software , 1985, IEEE Transactions on Software Engineering.

[9]  Damian M. Lyons,et al.  Representing and analyzing action plans as networks of concurrent processes , 1993, IEEE Trans. Robotics Autom..

[10]  G. MacEwen,et al.  Toward Fault-Tolerant Adaptive Real-Time Distributed Systems , 1992 .

[11]  Rami G. Melhem,et al.  Analysis of a fault-tolerant multiprocessor scheduling algorithm , 1994, Proceedings of IEEE 24th International Symposium on Fault- Tolerant Computing.

[12]  Reid G. Simmons,et al.  Concurrent planning and execution for a walking robot , 1990, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[13]  Anita Borg,et al.  A message system supporting fault tolerance , 1983, SOSP '83.

[14]  Stephen J. Maybank,et al.  Apparent area of a rigid moving body , 1987, Image Vis. Comput..

[15]  Alexander D. Stoyen,et al.  Real-Time Euclid: A language for reliable real-time systems , 1989, IEEE Transactions on Software Engineering.

[16]  Krishna Kant,et al.  Software fault tolerance in real-time systems , 1987, Inf. Sci..

[17]  Hermann Kopetz,et al.  Distributed fault-tolerant real-time systems: the Mars approach , 1989, IEEE Micro.

[18]  John Paul Shen,et al.  Processor Control Flow Monitoring Using Signatured Instruction Streams , 1987, IEEE Transactions on Computers.

[19]  N. I. Marzwell,et al.  Fault-tolerant robotic system for critical applications , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[20]  Daniel Mossé,et al.  Providing fault tolerance for active vision systems in real-time , 1997, Proceedings of International Conference on Robotics and Automation.

[21]  Kenneth P. Birman,et al.  Replication and fault-tolerance in the ISIS system , 1985, SOSP '85.

[22]  James W. Layland,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[23]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[24]  Joseph R. Cavallaro,et al.  A dynamic fault tolerance framework for remote robots , 1995, IEEE Trans. Robotics Autom..

[25]  Krithi Ramamritham,et al.  The Spring kernel: a new paradigm for real-time systems , 1991, IEEE Software.

[26]  Stuart Bennett,et al.  Computer Control of Real-Time Processes , 1990 .