Rotating line cameras: Model and calibration

The studied camera is basically just a line of pixel sensors, which can be rotated on a full circle, describing a cylindrical surface this way. During a rotation we take individual shots, line by line. All these line images define a panoramic image on a cylindrical surface. This camera architecture (in contrast to the plane segment of the pinhole camera) comes with new challenges, and this report is about a classification of different models of such cameras and their calibration. Acknowledgment. The authors acknowledge comments, collaboration or support by various students and colleagues at CITR Auckland and DLR Berlin-Adlershof. report1_HWK.tex; 22/03/2006; 9:47; p.1

[1]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[2]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[3]  Nicholas Ayache,et al.  Efficient registration of stereo images by matching graph descriptions of edge segments , 1987, International Journal of Computer Vision.

[4]  Reinhard Klette,et al.  Color Anaglyphs for Panorama Visualizations , 2000 .

[5]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[7]  Yiannis Aloimonos,et al.  A hierarchy of cameras for 3D photography , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[8]  R. Sára.  The Class of Stable Matchings for Computational Stereo , 1999 .

[9]  Harpreet S. Sawhney.  Simplifying motion and structure analysis using planar parallax and image warping , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[10]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Takuichi Nishimura,et al.  Spotting recognition of gestures performed by people from a single time-varying image , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[12]  Yael Pritch,et al.  Cameras for stereo panoramic imaging , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Karsten Scheibe,et al.  EYESCAN - A High Resolution Digital Panoramic Camera , 2001, RobVis.

[14]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[15]  Azriel Rosenfeld,et al.  Digital geometry - geometric methods for digital picture analysis , 2004 .

[16]  Shree K. Nayar,et al.  Planar catadioptric stereo: geometry and calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  P. Anandan,et al.  Video compression using mosaic representations , 1995, Signal Process. Image Commun..

[18]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[19]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[20]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[22]  Sanjiv Singh,et al.  Analysis and Design of Panoramic Stereo Vision Using Equi-Angular Pixel Cameras , 1999 .

[23]  Richard Szeliski,et al.  A layered video object coding system using sprite and affine motion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[24]  Shree K. Nayar,et al.  360/spl times/360 mosaics , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[25]  Harry Shum,et al.  Omnivergent Stereo , 2004, International Journal of Computer Vision.

[26]  Richard Szeliski,et al.  Direct methods for visual scene reconstruction , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[27]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[28]  Reinhard Klette,et al.  Computer vision - three-dimensional data from images , 1998 .

[29]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[30]  R. Sandau,et al.  The Stereo Camera Family WAOSS/WAAC for Spaceborne/Airborne Applications , 1995 .

[31]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[32]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[33]  Shree K. Nayar,et al.  Folded catadioptric cameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[34]  C. Fermuller,et al.  Eyes from eyes: new cameras for structure from motion , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[35]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[36]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[37]  Jpo Evans,et al.  3D measurement using rotating line-scan sensors , 1998 .

[38]  Michal Irani,et al.  Representation of scenes from collections of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[39]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Fay Huang,et al.  Determination of Geometric Parameters for Stereoscopic Panorama Cameras , 2001 .

[41]  Yasushi Yagi,et al.  Panorama scene analysis with conic projection , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[42]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[43]  Fay Huang,et al.  Stitching and Reconstruction of Linear-Pushbroom Panoramic Images for Planar Scenes , 2004, ECCV.

[44]  PollefeysMarc,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999 .

[45]  Yi-Ping Hung,et al.  Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming , 1998, Graph. Model. Image Process..

[46]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[47]  Georgy L. Gimel'farb,et al.  Probabilistic regularisation and symmetry in binocular dynamic programming stereo , 2002, Pattern Recognit. Lett..

[48]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[49]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.

[50]  P. Anandan,et al.  Direct recovery of shape from multiple views: a parallax based approach , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[51]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[52]  Amnon Shashua,et al.  Novel view synthesis in tensor space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Ralf Reulke,et al.  Der Drei-Zeilen CCD-Stereo-Scanner WAAC: Grundaufbau und Anwendungen in der Photogrammetrie , 1998 .

[54]  P. Anandan,et al.  Mosaic based representations of video sequences and their applications , 1995, Proceedings of IEEE International Conference on Computer Vision.

[55]  Shmuel Peleg,et al.  Stereo panorama with a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[56]  Reinhard Klette,et al.  Geometrical Fundamentals of Polycentric Panoramas , 2001, ICCV.

[57]  Paul Rademacher,et al.  Multiple-center-of-projection images , 1998, SIGGRAPH.

[58]  Cornelia Fermüller,et al.  The Argus eye: a new imaging system designed to facilitate robotic tasks of motion , 2004, IEEE Robotics & Automation Magazine.

[59]  Yasushi Yagi,et al.  Obstacle detection with omnidirectional image sensor HyperOmni Vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[60]  Ingemar J. Cox,et al.  A maximum likelihood N-camera stereo algorithm , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Gang Liu,et al.  Structure from Motion in the Presence of Noise , 2005 .

[62]  Henrik Nielsen,et al.  Using Mirror Cameras for Estimating Depth , 1995, CAIP.

[63]  Gang Xu,et al.  A General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras , 1997, IJCAI.

[64]  Reinhard Koch,et al.  Modelling and rendering of complex scenes with a multi-camera rig , 2004 .

[65]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[67]  Yasushi Yagi,et al.  Map-based navigation for a mobile robot with omnidirectional image sensor COPIS , 1995, IEEE Trans. Robotics Autom..

[68]  David W. Murray.  Recovering Range Using Virtual Multicamera Stereo , 1995, Comput. Vis. Image Underst..

[69]  Geb Thomas.  Real-time panospheric image dewarping and presentation for remote mobile robot control , 2003, Adv. Robotics.

[70]  Sing Bing Kang,et al.  Characterization of errors in compositing panoramic images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[71]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[72]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[73]  Steve Mann,et al.  Virtual bellows: constructing high quality stills from video , 1994, Proceedings of 1st International Conference on Image Processing.

[74]  Tomás Svoboda,et al.  Epipolar Geometry of Panoramic Cameras , 1998, ECCV.

[75]  Anders Heyden,et al.  Reconstruction from image sequences by means of relative depths , 1995, Proceedings of IEEE International Conference on Computer Vision.

[76]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 2004, International Journal of Computer Vision.

[77]  Reinhard Klette,et al.  Hyper-resolution and Polycentric Panorama Acquisition and Experimental Data Collection , 2001 .

[78]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[79]  Reinhard Klette,et al.  Three-Dimensional Scene Navigation Through Anaglyphic Panorama Visualization , 1999, CAIP.

[80]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[81]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[82]  Harpreet S. Sawhney,et al.  Compact Representations of Videos Through Dominant and Multiple Motion Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Reinhard Klette,et al.  Modeling 3D Scenes: Paradigm Shifts in Photogrammetry, Remote Sensing and Computer Vision , 2005 .

[84]  Cornelia Fermüller,et al.  Plenoptic video geometry , 2003, The Visual Computer.

[85]  Sing Bing Kang,et al.  Virtual Navigation of Complex Scenes using Clusters of Cylindrical Panoramic Images , 1998, Graphics Interface.

[86]  Reinhard Klette,et al.  Combinations of range data and panoramic images - new opportunities in 3D scene modeling , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[87]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[88]  Reinhard Klette,et al.  Image Stitching - Comparisons and New Techniques , 1999, CAIP.

[89]  Reinhard Klette,et al.  The design of a stereo panorama camera for scenes of dynamic range , 2002, Object recognition supported by user interaction for service robots.

[90]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[91]  Reinhard Klette,et al.  Stereo Reconstruction from Polycentric Panoramas , 2001, RobVis.

[92]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[93]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[94]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[95]  Michael Werman,et al.  Trilinearity of three perspective views and its associated tensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[96]  Shou-Kang Wei,et al.  Three-dimensional View Synthesis From Multiple Images , 1999 .

[97]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.