Line Localization from Single Catadioptric Images

Indoor environments often contain several line segments. The 3D reconstruction of such environments can thus be reduced to the localization of lines in the 3D space. Multi-view reconstruction requires the solution of the correspondence problem. The use of a single image to localize space lines is attractive, since the correspondence problem can be avoided. However, using a central camera the line localization from single image is an ill-posed problem, because there are infinitely many lines sharing the same image.In this work we relaxed the constraint on single viewpoint imaging and considered a wide class of non-central catadioptric cameras, constituted by an axial symmetric mirror and a perspective camera placed at a generic relative position. In the paper we report the results of our study on line localization for such cameras, reporting the conditions that allow a line to be localized from a single image. We show how the analysis can be extended to other classes of non-central devices sharing a similar imaging model. We also present a brief overview of the main algorithms for line localization from single image that have been proposed.

[1]  Saburo Tsuji,et al.  Panoramic representation of scenes for route understanding , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[2]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[3]  Peter F. Sturm,et al.  Camera Calibration and 3D Reconstruction from Single Images Using Parallelepipeds , 2001, ICCV.

[4]  Leonard McMillan,et al.  General Linear Cameras , 2004, ECCV.

[5]  Tomás Pajdla,et al.  Autocalibration & 3D reconstruction with non-central catadioptric cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Hazel Everett,et al.  Transversals to Line Segments in Three-Dimensional Space , 2005, Discret. Comput. Geom..

[7]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[8]  Daphna Weinshall,et al.  On the epipolar geometry of the Crossed-Slits projection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Vincenzo Caglioti,et al.  On the localization of straight lines in 3D space from single 2D images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Shree K. Nayar,et al.  Non-Single Viewpoint Catadioptric Cameras: Geometry and Analysis , 2006, International Journal of Computer Vision.

[11]  Fabio M. Marchese,et al.  Omni-Directional Vision with a Multi-part Mirror , 2000, RoboCup.

[12]  Pascal Vasseur,et al.  Calibration of the omnidirectional vision sensor: SYCLOP , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Yasushi Yagi,et al.  Panorama scene analysis with conic projection , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[14]  R. Gregory.  Eye and Brain: The Psychology of Seeing , 1966 .

[15]  P. Sturm.  A method for 3D reconstruction of piecewise planar objects from single panoramic images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[16]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[17]  James E. pLebensohn.  Geometry and the Imagination , 1952 .

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Shahriar Negahdaripour,et al.  Multi-camera conical imaging; calibration and robust 3-D motion estimation for ROV based mapping and positioning , 2002, OCEANS '02 MTS/IEEE.

[21]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Vincenzo Caglioti,et al.  Single-Image Calibration of Off-Axis Catadioptric Cameras Using Lines , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  Vincenzo Caglioti,et al.  Localization of 3 D lines from single images using off-axis catadioptric cameras , 2005 .

[24]  Brant C. White,et al.  United States patent , 1985 .

[25]  Harry Shum,et al.  Omnivergent Stereo , 2004, International Journal of Computer Vision.

[26]  Douglas Lanman,et al.  Reconstructing a 3D Line from a Single Catadioptric Image , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[27]  Jean Ponce.  What is a camera? , 2009, CVPR.

[28]  Vincenzo Caglioti,et al.  Methods for space line localization from single catadioptric images: new proposals and comparisons , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Frank Wolter,et al.  Exploring Artificial Intelligence in the New Millenium , 2002 .

[31]  S. L. Bogner.  An introduction to panospheric imaging , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[32]  Ruzena Bajcsy,et al.  Reflective surfaces as computational sensors , 2001, Image Vis. Comput..

[33]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[34]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[36]  Naokazu Yokoya,et al.  3D Scene Reconstruction from Reflection Images in a Spherical Mirror , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[37]  Simone Gasparini,et al.  Localization of straight lines from single images using off-axis catadioptric cameras , 2005, ICCV 2005.

[38]  Shmuel Peleg,et al.  Stereo panorama with a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[39]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.

[40]  Amnon Shashua,et al.  Trajectory Triangulation: 3D Reconstruction of Moving Points from a Monocular Image Sequence , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Seth J. Teller,et al.  Determining the Lines Through Four Lines , 1999, J. Graphics, GPU, & Game Tools.

[42]  Peter F. Sturm,et al.  Multi-view matching tensors from lines for general camera models , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[43]  Tomás Pajdla.  Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.

[44]  Stephen Parkinson,et al.  A Treatise on Optics , 2008 .

[45]  A. Croteau,et al.  Panocam: a digital high-resolution panoramic camera for underground installations survey , 2000, 2000 IEEE ESMO - 2000 IEEE 9th International Conference on Transmission and Distribution Construction, Operation and Live-Line Maintenance Proceedings. ESMO 2000 Proceedings. Global ESMO 2000. The Pow.

[46]  Ronen Basri,et al.  Example Based 3D Reconstruction from Single 2D Images , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[47]  Vincenzo Caglioti,et al.  "How many planar viewing surfaces are there in noncentral catadioptric cameras?" Towards singe-image localization of space lines , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[48]  Richard L. Gregory,et al.  Eye and brain: The psychology of seeing, 2nd ed. , 1973 .

[49]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[50]  J. Neumann,et al.  Multi-camera networks: eyes from eyes , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[51]  Peter F. Sturm,et al.  Multi-view geometry for general camera models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  Rahul Swaminathan,et al.  Depth From Distortions , 2008 .

[53]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Ruzena Bajcsy,et al.  Catadioptric sensors that approximate wide-angle perspective projections , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[55]  Helder Araújo,et al.  Paracatadioptric camera calibration using lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[56]  An overview of non-central cameras 1 Hynek Bakstein , 2001 .