4D Cities: Analyzing, Visualizing, and Interacting with Historical Urban Photo Collections

Vast collections of historical photographs are being digitally archived and placed online, providing an objective record of the last two centuries that remains largely untapped. In this work, we propose that time-varying 3D models can pull together and index large collections of images while also serving as a tool of historical discovery, revealing new information about the locations, dates, and contents of historical images. In particular, we use computer vision techniques to tie together large sets of historical photographs of a given city into a consistent 4D model of the city: a 3D model with time as an additional dimension.

[1]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[4]  Waldemar Uhl,et al.  Protective role of endogenous melatonin in the early course of human acute pancreatitis , 2011, Journal of pineal research.

[5]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[6]  W. De Backer,et al.  Antioxidant and anti-inflammatory efficacy of NAC in the treatment of COPD: discordant in vitro and in vivo dose-effects: a review. , 2007, Pulmonary pharmacology & therapeutics.

[7]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[8]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[9]  X. Yi.  On Automatic Differentiation , 2005 .

[10]  Romana Tomaszewska,et al.  Pinealectomy aggravates acute pancreatitis in the rat , 2010, Pharmacological reports : PR.

[11]  George Wolberg,et al.  Image morphing: a survey , 1998, The Visual Computer.

[12]  Hakan Özdemir,et al.  Melatonin Modulates the Severity of Taurocholate-Induced Acute Pancreatitis in the Rat , 2010, Digestive Diseases and Sciences.

[13]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[14]  F Takabayashi,et al.  Effects of Green Tea Catechins (Polyphenon 100) on Cerulein‐Induced Acute Pancreatitis in Rats , 1997, Pancreas.

[15]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[16]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[17]  R. Reiter,et al.  Biochemical reactivity of melatonin with reactive oxygen and nitrogen species , 2007, Cell Biochemistry and Biophysics.

[18]  Frank Dellaert,et al.  Inferring Temporal Order of Images From 3D Structure , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Griewank,et al.  On automatic differentiation , 1988 .

[20]  Mani Golparvar-Fard,et al.  Monitoring of Construction Performance Using Daily Progress Photograph Logs and 4D As-Planned Models , 2009 .

[21]  S. Malhotra,et al.  Melatonin treatment is beneficial in pancreatic repair process after experimental acute pancreatitis. , 2010, European journal of pharmacology.

[22]  Horst Bischof,et al.  Fusion of Feature- and Area-Based Information for Urban Buildings Modeling from Aerial Imagery , 2008, ECCV.

[23]  Frank Dellaert,et al.  Probabilistic temporal inference on reconstructed 3D scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[25]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[26]  Chip-Jin Ng,et al.  Delayed Neutrophil Apoptosis Attenuated by Melatonin in Human Acute Pancreatitis , 2005, Pancreas.