Translating Optical Flow Into Token Matches And Depth From Looming

MOTION IN THE ENVIRONMENT MANIFESTS ITSELF IN CHANGES OF MANY KINDS, NOT JUST IMAGE PLANE VELOCITIES, YET THESE ARE ALL THAT AN OPTICAL FLOW FIELD MAKES EXPLICIT. WE VIEW OPTICAL FLOW AS A USEFUL LOW-LEVEL REPRESENTATION FROM WHICH A SYMBOLIC DESCRIPTION OF CHANGE, IN THE FORM OF TOKEN MATCHES, CAN BE COMPUTED. THE TOKENS OF INTEREST TO US ARE THOSE PRODUCED BY PERCEPTUAL ORGANIZATION PROCESSES, AND ARE MORE ABSTRACT THAN EDGES OR INTEREST POINTS. WE DEMONSTRATE A WORKING SYSTEM FOR MATCHING LINE TOKENS WHICH USES THE OPTICAL FLOW FIELD IN A HEURISTIC MANNER TO LIMIT THE SEARCH FOR THE `MINIMAL BIPARTITE COVER'' OF THE SET OF TOKENS FROM EACH FRAME. AS AN EXAMPLE APPLICATION, WE DEMONSTRATE A TECHNIQUE FOR COMPUTING DISTANCE TO ENVIRONMENTAL SURFACES SUITABLE FOR OBSTACLE RECOGNITION BY A MOBILE ROBOT. ACCURATE KNOWLEDGE OF THE CAMERA MOTION PARAMETERS IS NOT REQUIRED. WE DESCRIBE HOW MOTION IN DEPTH MANIFESTS ITSELF IN THE PROJECTED LENGTHS AND AREAS OF ENVIRONMENTAL SURFACES WHOSE EXTENT IN DEPTH IS SMALL RELATIVE TO THEIR DISTANCE FROM THE CAMERA. RESULTS ON TWO SEQUENCES TAKEN BY A MOBILE ROBOT ARE PRESENTED TO DEMONSTRATE THE ACCURACY OF THE METHOD.

[1]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[2]  Hans P. Morevec Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[3]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..

[6]  P. Anandan Measuring Visual Motion From Image Sequences , 1987 .

[7]  Andrew P. Witkin,et al.  What Is Perceptual Organization For? , 1983, IJCAI.

[8]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[9]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  F. Glazer Hierarchical Motion Detection , 1987 .

[11]  Allen Brookes,et al.  Detecting structure by symbolic constructions on tokens , 1987, Comput. Vis. Graph. Image Process..