PHOTOGRAMMETRIC APPLICATIONS OF IMMERSIVE VIDEO CAMERAS

Abstract. The paper investigates immersive videography and its application in close-range photogrammetry. Immersive video involves the capture of a live-action scene that presents a 360° field of view. It is recorded simultaneously by multiple cameras or microlenses, where the principal point of each camera is offset from the rotating axis of the device. This issue causes problems when stitching together individual frames of video separated from particular cameras, however there are ways to overcome it and applying immersive cameras in photogrammetry provides a new potential. The paper presents two applications of immersive video in photogrammetry. At first, the creation of a low-cost mobile mapping system based on Ladybug®3 and GPS device is discussed. The amount of panoramas is much too high for photogrammetric purposes as the base line between spherical panoramas is around 1 metre. More than 92 000 panoramas were recorded in one Polish region of Czarny Dunajec and the measurements from panoramas enable the user to measure the area of outdoors (adverting structures) and billboards. A new law is being created in order to limit the number of illegal advertising structures in the Polish landscape and immersive video recorded in a short period of time is a candidate for economical and flexible measurements off-site. The second approach is a generation of 3d video-based reconstructions of heritage sites based on immersive video (structure from immersive video). A mobile camera mounted on a tripod dolly was used to record the interior scene and immersive video, separated into thousands of still panoramas, was converted from video into 3d objects using Agisoft Photoscan Professional. The findings from these experiments demonstrated that immersive photogrammetry seems to be a flexible and prompt method of 3d modelling and provides promising features for mobile mapping systems.

[1]  H.-G. Maas,et al.  COMBINED BUNDLE ADJUSTMENT OF PANORAMIC AND CENTRAL PERSPECTIVE IMAGES , 2005 .

[2]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[3]  Jafar Amiri Parian,et al.  A REFINED SENSOR MODEL FOR PANORAMIC CAMERAS , 2004 .

[4]  Spherical photogrammetry for cultural heritage: san galgano abbey, siena, italy and roman theatre, sabratha, libya , 2010, eHeritage '10.

[5]  S. Kenderdine.  Speaking in Rama: Panoramic Vision in Cultural Heritage Visualization , 2007 .

[6]  G. Fangi.  THE MULTI-IMAGE SPHERICAL PANORAMAS AS A TOOL FOR ARCHITECTURAL SURVEY , 2007 .

[7]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[8]  Enzo D’ANNIBALE,et al.  INTERACTIVE MODELLING BY PROJECTION OF ORIENTED SPHERICAL PANORAMA – AD DEIR, PETRA, JORDAN , 2009 .

[9]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[10]  Valerio Pascucci,et al.  Panorama weaving , 2012, ACM Trans. Graph..

[11]  Diane Gromala,et al.  Touching light: A new framework for immersion in artistic environments , 2007 .

[12]  Corinna Jacobs.  Interactive Panoramas: Techniques For Digital Panoramic Photography (X.Media.Publishing) , 2004 .

[13]  V. R. Mandla,et al.  3D Scene Reconstruction from Video Camera for Virtual 3D City Modeling , 2014 .

[14]  Emrah Emre Ozkeskin,et al.  SPHERICAL VIDEO RECORDING AND POSSIBLE INTERACTIVE EDUCATIONAL USES , 2010 .

[15]  John Belton,et al.  Shivers down your spine : cinema, museums, and the immersive view , 2008 .

[16]  K. Kwiatek,et al.  360° FILM BRINGS BOMBED CHURCH TO LIFE , 2012 .

[17]  Ka Chun Yu,et al.  Digital Full-Domes: The Future of Virtual Astronomy Education , 2005 .

[18]  Jane Mulligan,et al.  Panoramic video stitching , 2012 .

[19]  Jan-Michael Frahm,et al.  A Mobile 3 D City Reconstruction System , 2008 .

[20]  Martin Woolner,et al.  Transporting the Viewer Into a 360° heritage story: Panoramic interactive narrative presented on a wrap-around screen , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[21]  Richard Szeliski,et al.  Image Alignment and Stitching , 2006, Handbook of Mathematical Models in Computer Vision.

[22]  Jeffrey Shaw,et al.  Future cinema : the cinematic imaginary after film , 2003 .

[23]  Fabio Remondino,et al.  Automation in Multi-Image Spherical Photogrammetry for 3D Architectural Reconstructions , 2010, VAST.

[24]  Fabio Remondino,et al.  IMAGE-BASED 3 D MODELLING : A REVIEW , 2006 .

[25]  Armin Gruen,et al.  Fundamentals of videogrammetry — A review , 1997 .

[26]  Wilson J. Sarmiento,et al.  Panoramic Immersive Videos - 3D Production and Visualization Framework , 2009, SIGMAP.

[27]  E. Michaux.  Du panorama pictural au cinéma circulaire : origines et histoire d'un autre cinéma : 1785-1998 , 1999 .