A discrete event framework for autonomous observation under uncertainty

In this work we establish a framework for the general problem of observation, which may be applied to different kinds of visual tasks. We construct ‘intelligent’ high-level control mechanisms for active visual recognition of different processes within a hybrid dynamic system. We address the problem of observing a manipulation process in order to illustrate the ideas and motive behind our framework. We use a discrete event dynamic system as a high-level structuring technique to model the manipulation system. The formulation utilizes the knowledge about the system and the different actions in order to solve the observer problem in an efficient, stable and practical manner. The model uses different tracking mechanisms so that the observer can ‘see’ the workspace of the manipulating robot. An automaton is developed for the hand/object interaction over time and a stabilizing observer is constructed. Low-level modules are developed for recognizing the visual ‘events’ that causes state transitions within the dynamic manipulation system in real time. A coarse quantization of the manipulation actions is used in order to attain an active, adaptive and goaldirected sensing mechanism. The formulation provides high-level symbolic interpretations of the scene under observation. The discrete event framework is augmented with mechanisms for recovering the continuous parametric evolution of the scene under observation and for asserting the state of the manipulation agent. This work examines closely the possibilities for errors, mistakes and uncertainties in the manipulation system, observer construction process and event identification mechanisms. We identify and suggest techniques for modeling these uncertainties. Ambiguities are allowed to develop and are resolved after finite time. Error recovery mechanisms are also devised. The computed uncertainties are utilized for navigating the observer automaton state space, asserting state transitions and developing a suitable tracking mechanism.

[1]  Allen M. Waxman,et al.  Contour Evolution, Neighborhood Deformation, and Global Image Flow: Planar Surfaces in Motion , 1985 .

[2]  Cüneyt M. Özveren,et al.  Analysis and control of discrete event dynamic systems: a state space approach , 1989 .

[3]  C. A. R. Hoare,et al.  A Calculus of Durations , 1991, Inf. Process. Lett..

[4]  Sonia R. Sachs,et al.  Design Of Platoon Maneuver Protocols For IVHS , 1991 .

[5]  W. Wonham,et al.  Controllability and observability in the state-feedback control of discrete-event systems , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[6]  Matthew S. Clark.  Robot-Based Real-Time Motion Tracker , 1990, Other Conferences.

[7]  Ruzena Bajcsy,et al.  A model for observing a moving agent , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[8]  Lars Nielsen,et al.  Projective area-invariants as an extension of the cross-ratio , 1991, CVGIP Image Underst..

[9]  P. Guernic,et al.  Data-flow to Von Neumann : the SIGNAL approach , 1990 .

[10]  Pearl Pu,et al.  A new development in camera calibration calibrating a pair of mobile cameras , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[11]  Magnus Andersson,et al.  Tracking Lines in a Stereo Image Sequence , 1992 .

[12]  Jane W.-S. Liu,et al.  Scheduling Periodic Jobs That Allow Imprecise Results , 1990, IEEE Trans. Computers.

[13]  F. Chaumette,et al.  Vision-Based-Control for Robotic Tasks , 1990, Proceedings of the IEEE International Workshop on Intelligent Motion Control.

[14]  R. Suri,et al.  Perturbation analysis: the state of the art and research issues explained via the GI/G/1 queue , 1989, Proc. IEEE.

[15]  P. Ramadge,et al.  Modular feedback logic for discrete event systems , 1987 .

[16]  Pravin Varaiya,et al.  Two Proposals to Improve Freeway Traffic Flow , 1991, 1991 American Control Conference.

[17]  P. Varaiya,et al.  Sketch of an IVHS systems architecture , 1991, Vehicle Navigation and Information Systems Conference, 1991.

[18]  M. Heymann.  Concurrency and discrete event control , 1990, IEEE Control Systems Magazine.

[19]  Christos H. Papadimitriou,et al.  Elements of the Theory of Computation , 1997, SIGA.

[20]  Ruzena Bajcsy,et al.  Observing a Moving Agent , 1991 .

[21]  P. Bak,et al.  Self-organized criticality , 1991 .

[22]  P. Ramadge,et al.  Periodicity and chaos from switched flow systems: contrasting examples of discretely controlled continuous systems , 1993, IEEE Trans. Autom. Control..

[23]  SonOu Lee,et al.  Tracking Moving Objects by a Robot-held Camera using a Pyramid-based Image Processor , 1988 .

[24]  Narendra Ahuja,et al.  3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[26]  R. Bajcsy.  Active perception , 1988 .

[27]  A. F. Vaz,et al.  On supervisor reduction in discrete-event systems , 1986 .

[28]  Pravin Varaiya,et al.  The Design of Platoon Maneuvers for IVHS , 1991, 1991 American Control Conference.

[29]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch , 1981 .

[30]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[31]  Shimon Ullman,et al.  Analysis of Visual Motion by Biological and Computer Systems , 1981, Computer.

[32]  Roland Wilson,et al.  The Uncertainty Principle in Image Processing , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[34]  Alan S. Willsky,et al.  Aggregation and multi-level control in discrete event dynamic systems , 1992, Autom..

[35]  Ruzena Bajcsy,et al.  Visual observation of a moving agent , 1992 .

[36]  Fredrik Bergholm.  A Theory On Optical Velocity Fields And Ambiguous Motion Of Curves , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[37]  Ruzena Bajcsy,et al.  A Framework for Observing a Manipulation Process , 1990 .

[38]  Dana H. Ballard,et al.  Eye Fixation And Early Vision: Kinetic Depth , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[39]  Yu-Chi Ho,et al.  Performance evaluation and perturbation analysis of discrete event dynamic systems , 1987 .

[40]  C. Tomasi,et al.  Factoring image sequences into shape and motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[41]  György E. Révész.  Introduction to formal languages , 1983 .

[42]  Jan-Olof Eklundh,et al.  Object detection using model based prediction and motion parallax , 1990, ECCV.

[43]  I.E. Abdou,et al.  Quantitative design and evaluation of enhancement/thresholding edge detectors , 1979, Proceedings of the IEEE.

[44]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[45]  Lars Nielsen,et al.  Shape and Mutual Cross-Ratios with Applications to Orientation Problems , 1990 .

[46]  Joachim Heel,et al.  Dynamic Motion Vision , 1989, Other Conferences.

[47]  Robert M. Haralick,et al.  Context dependent edge detection and evaluation , 1990, Pattern Recognit..

[48]  Robert E. Schapire,et al.  Design and analysis of efficient learning algorithms , 1992, ACM Doctoral dissertation award ; 1991.

[49]  P. Le Guernic,et al.  Hybrid dynamical systems theory and the Signal language , 1990 .

[50]  Thomas O. Binford,et al.  Generic surface interpretation: observability model , 1988 .

[51]  The predictability of discrete event systems , 1989 .

[52]  Ruzena Bajcsy,et al.  Models for motion perception , 1987 .

[53]  Tarek M. Sobh,et al.  Recovery of 3-D Motion and Structure by Temporal Fusion , 1990, Other Conferences.

[54]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[55]  Edward S. Deutsch,et al.  A Quantitative Study of the Orientation Bias of Some Edge Detector Schemes , 1978, IEEE Transactions on Computers.

[56]  S Ullman,et al.  Maximizing Rigidity: The Incremental Recovery of 3-D Structure from Rigid and Nonrigid Motion , 1984, Perception.

[57]  Pravin Varaiya,et al.  Finitely recursive process models for discrete event systems , 1988 .

[58]  Edward S. Deutsch,et al.  On the Quantitative Evaluation of Edge Detection Schemes and their Comparison with Human Performance , 1975, IEEE Transactions on Computers.

[59]  Thierry Gautier,et al.  Programming real-time applications with SIGNAL , 1991, Proc. IEEE.

[60]  David Malah,et al.  A study of edge detection algorithms , 1982, Comput. Graph. Image Process..

[61]  H.-L. Wu,et al.  A Bayesian decision theoretic approach for adaptive goal-directed sensing , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[62]  Azriel Rosenfeld,et al.  Edge Evaluation Using Local Edge Coherence , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[63]  Michael Heymann,et al.  Supervisory control of concurrent discrete-event systems , 1991 .

[64]  A. Waxman,et al.  On the Uniqueness of Image Flow Solutions for Planar Surfaces in Motion , 1985 .

[65]  Peter J. Burt,et al.  Object tracking with a moving camera , 1989, [1989] Proceedings. Workshop on Visual Motion.

[66]  N. Ahuja,et al.  Segmentation, matching and estimation of structure and motion of textured piecewise planar surfaces , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[67]  E C Hildreth,et al.  Incremental rigidity scheme for recovering structure from motion: position-based versus velocity-based formulations. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[68]  Takeo Kanade,et al.  Shape and motion without depth , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[69]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[70]  守屋 悦朗,et al.  J.E.Hopcroft, J.D. Ullman 著, "Introduction to Automata Theory, Languages, and Computation", Addison-Wesley, A5変形版, X+418, \6,670, 1979 , 1980 .

[71]  Michael Heymann,et al.  Control of discrete event systems modeled as hierarchical state machines , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.