Automatic 3DS conversion of historical aerial photographs

In this paper we present a method for the generation of 3D stereo (3DS) pairs from sequences of historical aerial photographs. The goal of our work is to provide a stereoscopic display when the existing exposures are in a monocular sequence. Each input image is processed using its neighbours and a synthetic image is rendered, which, together with the original one, form a stereo pair. Promising results on real images taken from a historical photo archive are shown, that corroborate the viability of generating 3DS data from monocular footage.

[1]  Amnon Shashua,et al.  Novel View Synthesis by Cascading Trilinear Tensors , 1998, IEEE Trans. Vis. Comput. Graph..

[2]  Andrea Marchetti,et al.  Towards automatic stereo pair extraction for 3D visualisation of historical aerial photographs , 2014, 2014 International Conference on 3D Imaging (IC3D).

[3]  Liang-Gee Chen,et al.  A block-based 2D-to-3D conversion system with bilateral filter , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[4]  Rae-Hong Park,et al.  Weighted-adaptive motion-compensated frame rate up-conversion , 2003, IEEE Trans. Consumer Electron..

[5]  A. Stephenson,et al.  Air Photo Interpretation for Archaeologists , 1984 .

[6]  D. Cowley,et al.  From the Air: Understanding Aerial Archaeology , 2005 .

[7]  Andrea Fusiello,et al.  Novel View-Synthesis from Multiple Sources for Conversion to 3DS , 2015, ICIAP.

[8]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[9]  Andrea Fusiello,et al.  Quasi-Euclidean epipolar rectification of uncalibrated images , 2010, Machine Vision and Applications.

[10]  Andrea Fusiello,et al.  Specifying Virtual Cameras in Uncalibrated View Synthesis , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..

[13]  M. Rupp,et al.  Multiview synthesis from stereo views , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[14]  Andrea Marchetti,et al.  GeoMemories - A Platform for Visualizing Historical, Environmental and Geospatial Changes in the Italian Landscape , 2013, ISPRS Int. J. Geo Inf..

[15]  Andrea Fusiello,et al.  Uncalibrated dynamic stereo using parallax , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[16]  D. N. Riley.  Air photography and archaeology , 1987 .

[17]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  P. Anandan,et al.  Parallax Geometry of Pairs of Points for 3D Scene Analysis , 1996, ECCV.

[19]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  Hujun Bao,et al.  Stereoscopic Video Synthesis from a Monocular Video , 2007, IEEE Transactions on Visualization and Computer Graphics.

[22]  Andrea Marchetti,et al.  Stereo visualisation of historical aerial photos - a valuable digital heritage research tool , 2015, 2015 Digital Heritage.

[23]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[24]  Carlos Vázquez,et al.  3D-TV Content Creation: Automatic 2D-to-3D Video Conversion , 2011, IEEE Transactions on Broadcasting.

[25]  Andrea Fusiello,et al.  Uncalibrated View Synthesis with Homography Interpolation , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[26]  Daniel Cremers,et al.  Spatial and Temporal Interpolation of Multi-view Image Sequences , 2014, GCPR.

[27]  Yong Ju Jung,et al.  A novel 2D-to-3D conversion technique based on relative height-depth cue , 2009, Electronic Imaging.