Visual observation of a moving agent

We address the problem of observing a moving agent. In particular, we propose a system for observing a manipulation process, where a robot hand manipulates an object. A discrete event dynamic system (DEDS) frame work is developed for the hand/object interaction over time and a stabilizing observer is constructed. Low-level modules are developed for recognizing the “events” that causes state transitions within the dynamic manipulation system. The work examines closely the possibilities for errors, mistakes and uncertainties in the manipulation system, observer construction process and event identification mechanisms. The system utilizes different tracking techniques in order to observe and recognize the task in an active, adaptive and goal-directed manner.

[1]  A. Waxman,et al.  On the Uniqueness of Image Flow Solutions for Planar Surfaces in Motion , 1985 .

[2]  Peter J. Burt,et al.  Object tracking with a moving camera , 1989, [1989] Proceedings. Workshop on Visual Motion.

[3]  F. Chaumette,et al.  Vision-Based-Control for Robotic Tasks , 1990, Proceedings of the IEEE International Workshop on Intelligent Motion Control.

[4]  Cüneyt M. Özveren,et al.  Analysis and control of discrete event dynamic systems: a state space approach , 1989 .

[5]  Tarek M. Sobh,et al.  Recovery of 3-D Motion and Structure by Temporal Fusion , 1990, Other Conferences.

[6]  S Ullman,et al.  Maximizing Rigidity: The Incremental Recovery of 3-D Structure from Rigid and Nonrigid Motion , 1984, Perception.

[7]  Shimon Ullman,et al.  Analysis of Visual Motion by Biological and Computer Systems , 1981, Computer.

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  Ruzena Bajcsy,et al.  Observing a Moving Agent , 1991 .

[10]  Ruzena Bajcsy,et al.  A Framework for Observing a Manipulation Process , 1990 .

[11]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[12]  W. Wonham,et al.  Controllability and observability in the state-feedback control of discrete-event systems , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[13]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  P. Ramadge,et al.  Modular feedback logic for discrete event systems , 1987 .