Experiences and achievements in automated image sequence orientation for close-range photogrammetric projects

Automatic image orientation of close-range image blocks is becoming a task of increasing importance in the practice of photogrammetry. Although image orientation procedures based on interactive tie point measurements do not require any preferential block structure, the use of structured sequences can help to accomplish this task in an automated way. Automatic orientation of image sequences has been widely investigated in the Computer Vision community. Here the method is generally named "Structure from Motion" (SfM), or "Structure and Motion". These refer to the simultaneous estimation of the image orientation parameters and 3D object points of a scene from a set of image correspondences. Such approaches, that generally disregard camera calibration data, do not ensure an accurate 3D reconstruction, which is a requirement for photogrammetric projects. The major contribution of SfM is therefore viewed in the photogrammetric community as a powerful tool to automatically provide a dense set of tie points as well as initial parameters for a final rigorous bundle adjustment. The paper, after a brief overview of automatic procedures for close-range image sequence orientation, will show some characteristic examples. Although powerful and reliable image orientation solutions are nowadays available at research level, there are certain questions that are still open. Thus the paper will also report some open issues, like the geometric characteristics of the sequences, scene's texture and shape, ground constraints (control points and/or free-network adjustment), feature matching techniques, outlier rejection and bundle adjustment models.

[1]  A. Gruen ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[4]  Clive S. Fraser Network design considerations for non-topographic photogrammetry , 1994 .

[5]  Scott Joseph Mason Expert system-based design of close-range photogrammetric networks , 1995 .

[6]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[7]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  H. Handley AUTOMATION IN VIDEOGRAMMETRY , 2001 .

[9]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Xavier Armangué,et al.  Overall view regarding fundamental matrix estimation , 2003, Image Vis. Comput..

[11]  G. Büyüksalih,et al.  Practical experiences with automatic aerial triangulation using different software packages , 2003 .

[12]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[13]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[14]  Philip H. S. Torr,et al.  Bayesian Model Estimation and Selection for Epipolar Geometry and Generic Manifold Fitting , 2002, International Journal of Computer Vision.

[15]  M. Scaioni,et al.  A SOLUTION FOR THE GENERAL CASE OF THR THREE IMAGE ORIENTATION , 2004 .

[16]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[17]  Fabio Remondino,et al.  Photogrammetry for geological applications: automatic retrieval of discontinuity orientation in rock slopes , 2005 .

[18]  F. Remondinob,et al.  STRUCTURE AND MOTION RECONSTRUCTION OF SHORT MOBILE MAPPING IMAGE SEQUENCES , 2005 .

[19]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[20]  Riccardo Roncella Sviluppo e applicazioni di tecniche di automazione in fotogrammetria dei vicini , 2006 .

[21]  C. Fraser,et al.  Automated metric calibration of colour digital cameras , 2006 .

[22]  Fabio Remondino DETECTORS AND DESCRIPTORS FOR PHOTOGRAMMETRIC APPLICATIONS , 2006 .

[23]  Fabio Remondino,et al.  OVERVIEW AND EXPERIENCES IN AUTOMATED MARKERLESS IMAGE ORIENTATION , 2006 .

[24]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[25]  T. Läbe AUTOMATIC RELATIVE ORIENTATION OF IMAGES , 2006 .

[26]  W. Förstner NEW ORIENTATION PROCEDURES , 2007 .

[27]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[28]  Paolo Cignoni,et al.  Sampled 3D models for CH applications: A viable and enabling new medium or just a technological exercise? , 2008, JOCCH.

[29]  Henri Eisenbeiss,et al.  The Autonomous Mini Helicopter : a Powerful Platform for Mobile Mapping , 2008 .

[30]  Jean-Philippe Pons,et al.  Towards high-resolution large-scale multi-view stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Gianfranco Forlani,et al.  Advanced Geostructural Survey Methods Applied to Rock Mass Characterization , 2009 .

[32]  Ahmed Abdelhafiz,et al.  Integrating digital photogrammetry and terrestrial laser scanning , 2009 .

[33]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[34]  Fabio Remondino,et al.  Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation , 2010 .

[35]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[36]  P. Milano,et al.  FULLY AUTOMATIC UAV IMAGE-BASED SENSOR ORIENTATION , 2010 .

[37]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[38]  Andrea Fusiello,et al.  AUTOMATIC CAMERA ORIENTATION AND STRUCTURE RECOVERY WITH SAMANTHA , 2012 .

[39]  J. Beraldina,et al.  Best Practices for the 3 D Documentation of the Grotta dei Cervi of Porto Badisco , Italy , 2011 .

[40]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[41]  Roland Bless,et al.  Network Design , 2011, 4WARD Project.

[42]  J.-Angelo Beraldin,et al.  Best practices for the 3D documentation of the Grotta dei Cervi of Porto Badisco, Italy , 2011, Electronic Imaging.

[43]  Gianfranco Forlani,et al.  PERFORMANCE EVALUATION OF A STRUCTURE AND MOTION STRATEGY IN ARCHITECTURE AND CULTURAL HERITAGE , 2012 .

[44]  Fabio Remondino,et al.  AUTOMATED AND ACCURATE ORIENTATION OF COMPLEX IMAGE SEQUENCES , 2012 .

[45]  M. Pierrot Deseilligny,et al.  APERO, AN OPEN SOURCE BUNDLE ADJUSMENT SOFTWARE FOR AUTOMATIC CALIBRATION AND ORIENTATION OF SET OF IMAGES , 2012 .