Historical photography-based computer-aided architectural design: Demolished buildings information modeling with reverse engineering functionality

This paper is about single three-point perspective historical photography-based CAAD modeling (amateur camera calibration, pose and 3-d reconstruction) of man-made environments, buildings and monuments, rich in geometrical regularity. The proposed method, gains profit from the presence in the image (historical photography) of three vanishing directions and two orthogonal object edges with known length ration, and then focuses on the graphical estimation of the skew intrinsic parameter of the uncalibrated camera (i.e. the angle of dot's x and y optical axes, in photography plane), dealing in this way even with the skew presence case (non-rectangle dot). The presence of skew is not a negligible factor in historical photography of early 20th century years, due to dot optical axes failure (carelessness manufacturing) or collapse, as well as the twist effect (distortion) from the undocumented film development process in 1920s. The graphical recovery of the skew factor is the main contribution of the paper to the pose and CAAD literature. It is shown that a single three-point perspective amateur photography, even with the presence of skew, is adequate for calibration, pose and planar structure (building facades) recovery, if the usual in building's architecture geometric clues are present (i.e. planarity, orthogonality and parallelism) and some metric data (e.g. length and width of demolished building's dimensions) are available. The proposed method was validated on a simulated cuboid and demonstrated on a number of demolished historical buildings for which only one uncalibrated (and skewed) photography was available. The accuracy evaluation shows that the method is suitable for CAAD modeling applications regarding demolished buildings and monuments of the early 20th century years (2% relative accuracy, i.e. 40 cm for a 20 m facade, included the metric data inaccuracy). The method is of interest for architecture, archaeology, reverse engineering and virtual reality.

[1]  F. A. Heuvel.  Automation in Architectural Photogrammetry: Line-Photogrammetry for the Reconstruction from Single and Multiple Images , 2003 .

[2]  Allen Y. Yang,et al.  On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image , 2004, International Journal of Computer Vision.

[3]  Branko Kolarevic,et al.  Architecture in the Digital Age: Design and Manufacturing , 2004 .

[4]  Ferruh Yildiz,et al.  Documentation of historical caravansaries by digital close range photogrammetry , 2008 .

[5]  Ardeshir Mahdavi,et al.  Building model reconstruction based on sensed object location information , 2007 .

[6]  Henrik I. Christensen,et al.  Multiple Plane Segmentation Using Optical Flow , 2002, BMVC.

[7]  Antonios Andreatos,et al.  Advancing Electronic Assessment , 2007, Int. J. Comput. Commun. Control.

[8]  Tiberiu Vesselenyi,et al.  Fuzzy and Neural Controllers for a Pneumatic Actuator , 2007, Int. J. Comput. Commun. Control.

[9]  G. Carrara,et al.  Multi-modal Representation of Design Knowledge , 1992, Proceedings of the 10th International Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe).

[10]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[11]  Martin White,et al.  Usability Evaluation of a Virtual Museum Interface , 2006, Informatica.

[12]  Zhan-YiHu,et al.  Single View Based Measurement on Space Planes , 2004 .

[13]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[14]  Jana Kosecka,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[15]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Yehuda E. Kalay,et al.  Square peg in a round hole or horseless carriage? Reflections on the use of computing in architecture , 2002 .

[17]  Ioan Dzitac,et al.  60 Years from Birth of Academician F.G. Filip , 2007, Int. J. Comput. Commun. Control.

[18]  Roberto Cipolla,et al.  3D Model Acquisition from Uncalibrated Images , 1998, MVA.

[19]  Athanasios D. Styliadis,et al.  Digital documentation of historical buildings with 3-d modeling functionality , 2007 .

[20]  Zhanyi Hu,et al.  Camera calibration and 3D reconstruction from a single view based on scene constraints , 2005, Image Vis. Comput..

[21]  Peter F. Sturm,et al.  3D Modelling Using Geometric Constraints: A Parallelepiped Based Approach , 2002, ECCV.

[22]  Amar Mitiche,et al.  Visual reconstruction of ground plane obstacles in a sparse view robot environment , 2006, Graph. Model..

[23]  Frank A. van den Heuvel,et al.  3D reconstruction from a single image using geometric constraints , 1998 .

[24]  José Santos-Victor,et al.  Least-squares 3D reconstruction from one or more views and geometric clues , 2005, Comput. Vis. Image Underst..

[25]  Thalia S. Mantopoulou-Panagiotopoulou.  The Monastery of Aghios Menas in Thessaloniki , 1996 .

[26]  Yasuhiro Fujihara,et al.  Development of An Algorithm for Groupware Modeling for A Collaborative Learning , 2007, Int. J. Comput. Commun. Control.

[27]  Yi-Ping Hung,et al.  New calibration-free approach for augmented reality based on parameterized cuboid structure , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Allen Y. Yang,et al.  Symmetry-based 3-D reconstruction from perspective images , 2005, Comput. Vis. Image Underst..

[29]  Wolfgang Weber.  SelMa - Self-guided Learning in Teaching Mathematics , 2004, Informatics Educ..

[30]  Tony P. Pridmore,et al.  Assessment of a camera pose algorithm using images of brick sewers , 2001 .

[31]  Sabry F. El-Hakim,et al.  Detailed 3D reconstruction of large-scale heritage sites with integrated techniques , 2004, IEEE Computer Graphics and Applications.

[32]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[33]  Antonio Criminisi,et al.  Accurate Visual Metrology from Single and Multiple Uncalibrated Images , 2001, Distinguished Dissertations.

[34]  Paulo Bártolo,et al.  Integrated computational tools for virtual and physical automatic construction , 2006 .

[35]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  L. Grammatikopoulos,et al.  CAMERA CALIBRATION APPROACHES USING SINGLE IMAGES OF MAN-MADE OBJECTS , 2003 .

[37]  Hua Li,et al.  A new approach to image-based realistic architecture modeling with featured solid library , 2004 .

[38]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[39]  I. Kalisperakis,et al.  ON MULTI-IMAGE RECONSTRUCTION FROM HISTORIC PHOTOGRAPHS , 2003 .

[40]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Andrew Zisserman,et al.  Resolving ambiguities in auto–calibration , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[42]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[43]  E. Petsa,et al.  METRIC INFORMATION FROM UNCALIBRATED SINGLE IMAGES , 1999 .

[44]  Alan C. Bovik,et al.  Shape from Texture Using Local Spectral Moments , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Athanasios D. Styliadis,et al.  E-Learning Documentation of Historical Living Systems with 3-D Modeling Functionality , 2007, Informatica.

[46]  Mihaela-Monica Vladoiu,et al.  Towards Building an Open Digital Library for Instructional Design that Facilitates Reflective e-Instruction , 2004, Informatics Educ..

[47]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[48]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[49]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[50]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[51]  Livio De Luca,et al.  Reverse engineering of architectural buildings based on a hybrid modeling approach , 2006, Comput. Graph..

[52]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Yehuda E. Kalay,et al.  The impact of information technology on design methods, products and practices , 2006 .

[54]  Daniel Breaz,et al.  Integral operators on the TUCD-class. , 2004 .

[55]  Stéphane Potier,et al.  Computer graphics: assistance for archaelogical hypotheses , 2000 .

[56]  Edmond Boyer,et al.  Camera calibration and 3D reconstruction from single images using parallelepipeds , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.