Revisiting district six: a case study of digital heritage reconstruction from archival photographs

This paper investigates the digital reconstruction of destroyed buildings from small sets of old, uncalibrated photographs. The application domain is the heritage preservation of District Six -- a mixed race area in Cape Town that was leveled during the South African Apartheid regime and whose residents were forcibly removed. Our framework uses a combination of semi-automatic camera calibration, model-based architecture-specific photogrammetry, and texture synthesis to reconstruct the geometry and texture of a building so that it can be incorporated into a heritage-based virtual environment, such as a museum display. These techniques are well established in isolation; the purpose here is to discover if they can be adapted to damaged and uncalibrated photographs, where the time periods and chromatic schemes differ or where, in the worst case, only a single photograph is available. To test the effectiveness of the reconstruction framework we consider three representative cases of District Six architecture. All three cases were reconstructed successfully with some provisos concerning uneven ground, intricate building features, and unfavourable camera angles.

[1]  Sabry F. El-Hakim,et al.  Virtualizing a Byzantine Crypt by Combining High-resolution Textures with Laser Scanner 3D Data , 2002 .

[2]  Markus Niederöst,et al.  Reconstruction of the Disentis monastery from high resolution still video imagery with object oriented measurement routines , 1998 .

[3]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[4]  José Carlos Teixeira,et al.  Cultural Heritage in the Mature Era of Computer Graphics , 2000, IEEE Computer Graphics and Applications.

[5]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[6]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[7]  Marc Alexa,et al.  Hybrid Texture Synthesis , 2003, Rendering Techniques.

[8]  Sabry F. El-Hakim,et al.  Detailed 3D reconstruction of large-scale heritage sites with integrated techniques , 2004, IEEE Computer Graphics and Applications.

[9]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[10]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[11]  Armin Grün,et al.  Photogrammetric reconstruction and 3D visualisation of Bet Giorgis, a rock-hewn church in Ethiopia , 2001 .

[12]  F. A. Heuvel ESTIMATION OF INTERIOR ORIENTATION PARAMETERS FROM CONSTRAINTS ON LINE MEASUREMENTS IN A SINGLE IMAGE , 1999 .

[13]  J.-A. Beraldin Virtual Reconstruction of Heritage Sites: Opportunities and Challenges Created by 3D Technologies * , 2005 .

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Edmond Boyer,et al.  Camera calibration and 3D reconstruction from single images using parallelepipeds , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Li Zhang,et al.  Image-based reconstruction of the Great Buddha of Bamiyan, Afghanistan , 2003, IS&T/SPIE Electronic Imaging.

[17]  Michael Garland,et al.  Towards Real-Time Texture Synthesis with the Jump Map , 2002, Rendering Techniques.

[18]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[19]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[20]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.