Two-frame structure from motion using optical flow probability distributions for unmanned air vehicle obstacle avoidance

See-and-avoid behaviors are an essential part of autonomous navigation for Unmanned Air Vehicles (UAVs). To be fully autonomous, a UAV must be able to navigate complex urban and near-earth environments and detect and avoid imminent collisions. While there have been significant research efforts in robotic navigation and obstacle avoidance during the past few years, this previous work has not focused on applications that use small autonomous UAVs. Specific UAV requirements such as non-invasive sensing, light payload, low image quality, high processing speed, long range detection, and low power consumption, etc., must be met in order to fully use this new technology. This paper presents single camera collision detection and avoidance algorithm. Whereas most algorithms attempt to extract the 3D information from a single optical flow value at each feature point, we propose to calculate a set of likely optical flow values and their associated probabilities—an optical flow probability distribution. Using this probability distribution, a more robust method for calculating object distance is developed. This method is developed for use on a UAV to detect obstacles, but it can be used on any vehicle where obstacle detection is needed.

[1]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[2]  Francois Blais,et al.  Compact three-dimensional camera for robotic applications , 1986 .

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  Trevor Darrell,et al.  Pyramid based depth from focus , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  W. Burger,et al.  On computing a 'fuzzy' focus of expansion for autonomous navigation , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  M. Turk,et al.  A simple, real-time range camera , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  S. Ullman,et al.  Direct computation of the focus of expansion from velocity field measurements , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[8]  J. Oliensis,et al.  Incorporating motion error in multi-frame structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[9]  Rama Chellappa,et al.  Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[12]  Mubarak Shah,et al.  Interpretation of Motion Trajectories using Focus of Expansion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[14]  Georgy L. Gimel'farb Intensity-based bi- and trinocular stereo vision: Bayesian decisions and regularizing assumptions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[15]  Eero P. Simoncelli,et al.  Linear Structure From Motion , 1994 .

[16]  Allan D. Jepson,et al.  Linear subspace methods for recovering translational direction , 1994 .

[17]  Reinhard Koch,et al.  3-D surface reconstruction from stereoscopic image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[18]  Daniel Raviv,et al.  2D feature tracking algorithm for motion analysis , 1995, Pattern Recognit..

[19]  Lance D. Chambers Practical handbook of genetic algorithms , 1995 .

[20]  J. Oliensis,et al.  Multiframe structure from motion in perspective , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[21]  Tarak Gandhi,et al.  Detection of obstacles on runway using ego-motion compensation and tracking of significant features , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[22]  Arcangelo Distante,et al.  Focus of expansion estimation with a neural network , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[23]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[24]  Illah R. Nourbakhsh,et al.  Mobile robot obstacle avoidance via depth from focus , 1997, Robotics Auton. Syst..

[25]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Takeo Kanade,et al.  A unified factorization algorithm for points, line segments and planes with uncertainty models , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  Steven A. Shafer,et al.  Dense Structure from a Dense Optical Flow Sequence , 1998, Comput. Vis. Image Underst..

[28]  Harry Shum,et al.  Efficient bundle adjustment with virtual key frames: a hierarchical approach to multi-frame structure from motion , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[29]  J.C. Alvarez,et al.  Fast stereo vision algorithm for robotic applications , 1999, 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation. Proceedings ETFA '99 (Cat. No.99TH8467).

[30]  David A. Forsyth,et al.  Bayesian structure from motion , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[31]  Yakup Genc,et al.  Fast algorithms for projective multi-frame structure from motion , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[32]  John Oliensis,et al.  An Experimental Study of Projective Structure From Motion , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  John Oliensis Direct multi-frame structure from motion for hand-held cameras , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[34]  Albert Dipanda,et al.  Matching lines and points in an active stereo vision system using genetic algorithms , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[35]  Lance D. Chambers The Practical Handbook of Genetic Algorithms: Applications, Second Edition , 2000 .

[36]  Frank Dellaert,et al.  Structure from motion without correspondence , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[37]  Yassine Ruichek,et al.  Genetic approach for obstacle detection using linear stereo vision , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[38]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[39]  A. Murat Tekalp,et al.  Error Characterization of the Factorization Method , 2001, Comput. Vis. Image Underst..

[40]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Henrik I. Christensen,et al.  Maximum likelihood structure and motion estimation integrated over time , 2002, Object recognition supported by user interaction for service robots.

[42]  Henrik Aanæs,et al.  Robust Factorization , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[44]  Stefano Soatto,et al.  A semi-direct approach to structure from motion , 2003, The Visual Computer.

[45]  Clark F. Olson,et al.  Rover navigation using stereo ego-motion , 2003, Robotics Auton. Syst..

[46]  Yair Weiss,et al.  Multibody factorization with uncertainty and missing data using the EM algorithm , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[47]  Randal W. Beard,et al.  Obstacle avoidance for unmanned air vehicles using optical flow probability distributions , 2004, SPIE Optics East.

[48]  Stefano Soatto,et al.  Optimal Structure from Motion: Local Ambiguities and Global Estimates , 2004, International Journal of Computer Vision.

[49]  Richard Szeliski,et al.  Bayesian modeling of uncertainty in low-level vision , 2011, International Journal of Computer Vision.

[50]  Dah-Jye Lee,et al.  Statistical analysis of multiple optical flow values for estimation of unmanned aerial vehicle height above ground , 2004, SPIE Optics East.

[51]  P. Perona,et al.  Recursive 3-D Visual Motion Estimation Using Subspace Constraints , 1997, International Journal of Computer Vision.

[52]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[53]  John Oliensis,et al.  A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection , 1999, International Journal of Computer Vision.

[54]  P. Anandan,et al.  Factorization with Uncertainty , 2000, International Journal of Computer Vision.

[55]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[56]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[57]  Paul Merrell,et al.  Structure from motion using optical flow probability distributions , 2005, SPIE Defense + Commercial Sensing.

[58]  Dah-Jye Lee,et al.  Real-time Feature Tracking on an Embedded Vision Sensor for Small Vision-guided Unmanned Vehicles , 2007, 2007 International Symposium on Computational Intelligence in Robotics and Automation.

[59]  Dah-Jye Lee,et al.  A Fast and Accurate Tensor-based Optical Flow Algorithm Implemented in FPGA , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[60]  Dah-Jye Lee,et al.  FPGA-based Real-time Optical Flow Algorithm Design and Implementation , 2007, J. Multim..