Panoramic imaging - a review

Panoramic imaging has important implications in robotics, computer vision and virtual reality. This paper reviews representative work in the design and development of 2D/3D panoramic image capturing systems, the advancement of auto-calibration, registration and corresponding techniques, stereo vision, 3D reconstruction and image-based rendering. The paper discusses the above work within four parts of the panoramic imaging process: capturing system, image processing for panoramic imaging, image stitching and 3D reconstruction, image-based rending and visualisation. The design and development of a panoramic system pays careful attention to the following issues: image capturing, image registration, camera calibration, feature extraction, image understanding and image stitching. The objective of this review paper is to summarise and compare some of the methods in the various stages and identify research topics and applications, which are at the forefront of this exciting and challenge field.

[1]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[2]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[3]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[4]  Camillo J. Taylor,et al.  Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[9]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[10]  Dan Xu,et al.  Complex wavelet-based image mosaics using edge-preserving visual perception modeling , 1999, Comput. Graph..

[11]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Yi-Ping Hung,et al.  Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming , 1998, Graph. Model. Image Process..

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Yoshiaki Shirai,et al.  Real-time omnidirectional stereo for obstacle detection and tracking in dynamic environments , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[16]  Tomás Svoboda,et al.  Epipolar Geometry of Panoramic Cameras , 1998, ECCV.

[17]  Paul S. Heckbert,et al.  Fundamentals of Texture Mapping and Image Warping , 1989 .

[18]  B. S. Manjunath,et al.  Panoramic video capturing and compressed domain virtual camera control , 2001, MULTIMEDIA '01.

[19]  Franc Solina,et al.  Mosaic-based panoramic depth imaging with a single standard camera , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[20]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.

[21]  Aly A. Farag,et al.  Fast 3D object reconstruction using trinocular vision and structured light , 1998, Other Conferences.

[22]  Steve Mann,et al.  Virtual bellows: constructing high quality stills from video , 1994, Proceedings of 1st International Conference on Image Processing.

[23]  Yael Pritch,et al.  Cameras for stereo panoramic imaging , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[24]  Narendra Ahuja,et al.  High dynamic range panoramic imaging , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[26]  Maurizio Pilu,et al.  A direct method for stereo correspondence based on singular value decomposition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Gui Yun Tian,et al.  Color Normalization for Color Object Recognition , 1999, Int. J. Pattern Recognit. Artif. Intell..

[28]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[29]  Naokazu Yokoya,et al.  Telepresence by Real-Time View-Dependent Image Generation from Omnidirectional Video Streams , 1998, Comput. Vis. Image Underst..

[30]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .

[31]  Gregory Dudek,et al.  Automated creation of image-based virtual reality , 1997, Other Conferences.

[32]  Daniel G. Aliaga,et al.  Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs , 2001, SIGGRAPH.

[33]  Aggelos K. Katsaggelos,et al.  Dense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique , 1999, IEEE Trans. Multim..

[34]  Alan M. McIvor,et al.  Accurate 3D measurement using a structured light system , 1998, Image Vis. Comput..

[35]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[36]  Jong-Il Park,et al.  Hierarchical Depth Mapping from Multiple Cameras , 1997, ICIAP.

[37]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[38]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[39]  R. Hartley.  Triangulation, Computer Vision and Image Understanding , 1997 .

[40]  Rachid Deriche,et al.  Using geometric corners to build a 2D mosaic from a set of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Leonard McMillan,et al.  Acquiring Immersive Virtual Environments with an Uncalibrated Camera , 1995 .

[42]  Allen R. Hanson,et al.  STEREO MOSAICS FROM A MOVING VIDEO CAMERA FOR ENVIRONMENTAL MONITORING , 1999 .

[43]  Hyun-Chul Kim,et al.  Stitching reliability for estimating camera focal length in panoramic image mosaicing , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[44]  Yoichi Muraoka,et al.  Real-time image mosaicing from a video sequence , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[45]  Tomas Pajdla,et al.  Panoramic cameras for 3D computation , 2000 .

[46]  Yael Pritch,et al.  Optics for Omnistereo Imaging , 2001 .

[47]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[48]  José M. F. Moura,et al.  Three-dimensional modeling from two-dimensional video , 2001, IEEE Trans. Image Process..

[49]  Paul S. Heckbert,et al.  Projective Mappings for Image Warping , 1995 .

[50]  Nikolaos Grammalidis,et al.  Disparity field and depth map coding for multiview 3D image generation , 1998, Signal Process. Image Commun..

[51]  Hiroyuki Ohno,et al.  An optical see-through display for mutual occlusion with a real-time stereovision system , 2001, Comput. Graph..

[52]  Ebroul Izquierdo,et al.  Image Analysis for 3D Modeling, Rendering, and Virtual View Generation , 1998, Comput. Vis. Image Underst..