Angle consistency for registration between catadioptric omni-images and orthorectified aerial images

Registration between catadioptric omni-images and orthorectified aerial images is the key step to integrate them to achieve three-dimensional urban construction. This problem becomes very challenging because of the non-linearity of the imaging model of catadioptric omni-cameras. In this study, the authors attempt to address this problem. The authors first study the properties of horizontal line structure under catadioptric omni-cameras to prove and extend the theorem of catadioptric distance, and then present angle consistency of horizontal lines between a catadioptric omni-image and an orthorectified aerial image. The authors further employ them to achieve registration between catadioptric omni-images and orthorectified aerial images. To the best of authors’ knowledge, this study has not been done before. Experimental results on both simulated data and real scene images confirm the effectiveness of this approach.

[1]  Keith Yu Kit Leung,et al.  Localization in urban environments by matching ground level video images with an aerial image , 2008, 2008 IEEE International Conference on Robotics and Automation.

[2]  Helder Araújo,et al.  Direct Least Square Fitting of Paracatadioptric Line Images , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Norbert Haala,et al.  A multi-sensor system for positioning in urban environments , 2003 .

[4]  Radu Orghidan,et al.  Catadioptric single-shot rangefinder for textured map building in robot navigation , 2007 .

[5]  Liang-Tien Chia,et al.  Estimating camera pose from a single urban ground-view omnidirectional image and a 2D building outline map , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Radu Mihnea Udrea,et al.  Iterative generalization of morphological skeleton , 2007, J. Electronic Imaging.

[7]  Pascal Vasseur,et al.  Central catadioptric image processing with geodesic metric , 2011, Image Vis. Comput..

[8]  Radu Mihnea Udrea,et al.  Visual-oriented morphological foreground content grayscale frames interpolation method , 2009, J. Electronic Imaging.

[9]  Lu Wang,et al.  Large-Scale Urban Modeling by Combining Ground Level Panoramic and Aerial Imagery , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[10]  Vincenzo Caglioti,et al.  Line Localization from Single Catadioptric Images , 2011, International Journal of Computer Vision.

[11]  Anup Basu,et al.  A 2-point algorithm for 3D reconstruction of horizontal lines from a single omni-directional image , 2011, Pattern Recognit. Lett..

[12]  Suya You,et al.  Integrating LiDAR, Aerial Image and Ground Images for Complete Urban Building Modeling , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[13]  Pascal Vasseur,et al.  Particle Filter Approach Adapted to Catadioptric Images for Target Tracking Application , 2009, BMVC.

[14]  Vincenzo Caglioti,et al.  On the localization of straight lines in 3D space from single 2D images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Hongbin Zha,et al.  Identical Projective Geometric Properties of Central Catadioptric Line Images and Sphere Images with Applications to Calibration , 2008, International Journal of Computer Vision.

[16]  Wei Xu,et al.  Automatic 3D Reconstruction from a Single Catadioptric Omnidirectional Image , 2010, Int. J. Virtual Real..

[17]  J. Meguro,et al.  Development of positioning technique using omni-directional IR camera and aerial survey data , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[18]  Maojun Zhang,et al.  Series-parallel pipeline architecture for high-resolution catadioptric panoramic unwrapping , 2010 .

[19]  Mustafa Turker,et al.  BUILDING EXTRACTION FROM HIGH RESOLUTION SATELLITE IMAGES USING HOUGH TRANSFORM , 2010 .

[20]  Tom Duckett,et al.  Fusion of aerial images and sensor data from a ground vehicle for improved semantic mapping , 2008, Robotics Auton. Syst..

[21]  Christian Früh,et al.  Constructing 3D City Models by Merging Aerial and Ground Views , 2003, IEEE Computer Graphics and Applications.

[22]  Ramakant Nevatia,et al.  Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line Clustering , 2002, Comput. Graph. Forum.

[23]  Lu Wang,et al.  Semiautomatic registration between ground-level panoramas and an orthorectified aerial image for building modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[24]  Anup Basu,et al.  Hough transform for feature detection in panoramic images , 2002, Pattern Recognit. Lett..

[25]  Matthew Brand,et al.  SKYLINE2GPS: Localization in urban canyons using omni-skylines , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.