Immersive Photogrammetry in 3 D Modelling

Panoramic photography, on a massive scale, is widely used by Google Street View (exterior panoramas), Google Business View (company interiors) and Google Photo Sphere (Internet users create their own panoramic virtual tours using tablets and smartphones). These applications enable navigation outside and inside buildings. The navigation is possible by clicking arrows. The user clicks an arrow when they want to move in a specifi c direction. This method of moving, however, does not create a sense of continuity of movement which can be achieved when panoramas are presented as a video. However, in immersive video, when presenting a specifi c trajectory, it is not possible to change directions. A sequence of panoramas presented as a 360° video is defi ned as an immersive video or 360° video [7]. This form of presentation has not become very popular mainly due to large sizes of fi les (e.g. 1-minute raw video is a fi le whose size is about 1–2 GB; the fi le needs to be compressed in order to be presented on-line) [13]. Immersive video typically consists of 15–30 panoramas/second. So far, such a large amount of data has not been widely explored for photogrammetric purposes. Furthermore, no metric tools have been added to Google panoramic virtual tours and to immersive video. Immersive video is created by combining images generated by digital cameras that record in various directions. This video is becoming a new form of presenting art projects on interactive exhibitions, in fi lm clips and also in advertising [18]. 3D modelling from panoramic images is well know and described in [4, 14, 17, 19]. However, the potential of photogrammetric immersive video has not been examined so far and it is the subject of our experiments.

[1]  G. Fangi THE MULTI-IMAGE SPHERICAL PANORAMAS AS A TOOL FOR ARCHITECTURAL SURVEY , 2007 .

[2]  H. Maas,et al.  GEOMETRIC MODELLING AND CALIBRATION OF A HIGH RESOLUTION PANORAMIC CAMERA , 2003 .

[3]  Fabio Remondino,et al.  Automation in Multi-Image Spherical Photogrammetry for 3D Architectural Reconstructions , 2010, VAST.

[4]  Yun Shi,et al.  GPS-Supported Visual SLAM with a Rigorous Sensor Model for a Panoramic Camera in Outdoor Environments , 2012, Sensors.

[5]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[6]  John Belton,et al.  Shivers down your spine : cinema, museums, and the immersive view , 2008 .

[7]  K. Kwiatek,et al.  360° FILM BRINGS BOMBED CHURCH TO LIFE , 2012 .

[8]  T. Yamamoto,et al.  Panoramic rendering-based polygon extraction from indoor mobile LiDAR data , 2014 .

[10]  Frank Dellaert,et al.  Probabilistic structure matching for visual SLAM with a multi-camera rig , 2010, Comput. Vis. Image Underst..

[11]  Gabriele Guidi,et al.  Image pre-processing for optimizing automated photogrammetry performances , 2014 .

[12]  H. Maas,et al.  APPLICATION AND ACCURACY POTENTIAL OF A STRICT GEOMETRIC MODEL FOR ROTATING LINE CAMERAS , 2004 .

[13]  Martin Woolner,et al.  Embedding Interactive Storytelling within Still and Video Panoramas for Cultural Heritage Sites , 2009, 2009 15th International Conference on Virtual Systems and Multimedia.

[14]  M. Hebert,et al.  Omni-directional structure from motion , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[15]  H.-G. Maas,et al.  COMBINED BUNDLE ADJUSTMENT OF PANORAMIC AND CENTRAL PERSPECTIVE IMAGES , 2005 .

[16]  G. Fangi,et al.  Photogrammetric Processing of Spherical Panoramas , 2013 .

[17]  Didier Stricker,et al.  Structure from Motion using full spherical panoramic cameras , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[18]  3-D OBJECT RECONSTRUCTION FROM MULTIPLE-STATION PANORAMA IMAGERY , 2004 .

[19]  Jafar Amiri Parian,et al.  A REFINED SENSOR MODEL FOR PANORAMIC CAMERAS , 2004 .

[20]  K. Kwiatek,et al.  PHOTOGRAMMETRIC APPLICATIONS OF IMMERSIVE VIDEO CAMERAS , 2014 .

[21]  M. Bednarczyk,et al.  Propozycje wykorzystania zdjęć panoramicznych w GIS i geodezji , 2014 .