Issues in advanced image registration for multi-UAV platform applications

Image registration is in some senses the 'forgotten problem' in multi-sensor image exploitation. Image registration will, at present, typically involve using a constant registration transform to align images from sensors fixed relative to each other and separated by as small a distance as possible. For more challenging situations in which sensors are more widely spaced and not fixed relative to each other (e.g. teams of Uninhabited Air Vehicles, UAVs) the registration problem becomes far more complex. The theory of solving the registration problem for such situations is poorly understood with outstanding issues being the expected optimal image alignment, how to perform automatic registration, and methods of addressing time varying image registration. As a pre-cursor to the solution of such problems we present an analysis of the likely errors associated with more complex registration problems. Results of trials using current state-of-the-art technology are presented followed by initial concepts in improving these results.

[1]  S. Kovacic,et al.  Nonparametric, Model-Based Radial Lens Distortion Correction Using Tilted Camera Assumption , 2002 .

[2]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[3]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[4]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[5]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[6]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[7]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[8]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[9]  Yaser Sheikh,et al.  ALIGNING ‘DISSIMILAR’ IMAGES DIRECTLY , 2003 .

[10]  Ruzena Bajcsy,et al.  Modelling and Removing Radial and Tangential Distortions in Spherical Lenses , 2000, Theoretical Foundations of Computer Vision.

[11]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[12]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[13]  Andreas Koschan,et al.  A new multi-sensor registration technique for three-dimensional scene modeling with application to unmanned vehicle mobility enhancement , 2005, SPIE Defense + Commercial Sensing.

[14]  Richard Szeliski,et al.  Spline-Based Image Registration , 1997, International Journal of Computer Vision.

[15]  J.P. Heather,et al.  Multimodal image registration with applications to image fusion , 2005, 2005 7th International Conference on Information Fusion.

[16]  Andrew W. Fitzgibbon,et al.  Automatic 3D model acquisition and generation of new images from video sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Raj Madhavan,et al.  Temporal Range Registration for Unmanned Ground and Aerial Vehicles , 2004, ICRA.

[19]  Hany Farid,et al.  Differential Elastic Image Registration , 2001 .

[20]  Jamie P. Heather,et al.  A review of image fusion technology in 2005 , 2005, SPIE Defense + Commercial Sensing.

[21]  Anup Basu,et al.  Alternative models for fish-eye lenses , 1995, Pattern Recognit. Lett..

[22]  P. Anandan,et al.  Robust multi-sensor image alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.