Email this article 4D Cities: Analyzing, Visualizing, and Interacting with Historical Urban Photo Collections
Abstract
Vast collections of historical photographs are being digitally archived and placed online, providing an objective record of the last two centuries that remains largely untapped. In this work, we propose that time-varying 3D models can pull together and index large collections of images while also serving as a tool of historical discovery, revealing new information about the locations, dates, and contents of historical images. In particular, we use computer vision techniques to tie together large sets of historical photographs of a given city into a consistent 4D model of the city: a 3D model with time as an additional dimension.
Keywords
References
[1] S. Agarwal, N. Snavely, I. Simon, S. M. Seitz, and R. Szeliski. Building rome in a day. In Intl. Conf. on Computer Vision (ICCV), 2009.
[2] P. Debevec, Y. Yu, and G. Borshukov. Efficient view-dependent image- based rendering with projective texture-mapping. In Eurographics Workshop on Rendering, pages 105–116, 1998.
[3] P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. SIGGRAPH, 30:11–20, 1996.
[4] O.D. Faugeras and Q.T. Luong. The geometry of multiple images. The MIT press, Cambridge, MA, 2001. with contributions from T. Papadopoulo.
[5] M. Golparvar-Fard, F. Peña-Mora, and S. Savarese. Monitoring of construction performance using daily progress photograph logs and 4d as-planned models. In ASCE International Workshop on Computing in Civil Engineering, 2009.
http://dx.doi.org/10.1061/41052(346)6
[6] A. Griewank. On Automatic Differentiation. In M. Iri and K. Tanabe, editors, Mathematical Programming: Recent Developments and Appli- cations, pages 83–108. Kluwer Academic Publishers, 1989.
[7] R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2000.
[8] C. Schmid L. Lazebnik and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2006.
[9] M. Pollefeys, D. Nistér, J.M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.J. Kim, P. Merrell, et al. Detailed real-time urban 3d reconstruction from video. International Journal of Computer Vision, 78(2):143–167, 2008.
http://dx.doi.org/10.1007/s11263-007-0086-4
[10] G. Schindler, F. Dellaert, and S.B. Kang. Inferring temporal order of images from 3D structure. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2007.
http://dx.doi.org/10.1109/CVPR.2007.383088
[11] Grant Schindler and Frank Dellaert. Probabilistic temporal inference on reconstructed 3d scenes. In CVPR, 2010.
[12] S.M. Seitz and C.R. Dyer. View morphing. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pages 21–30. ACM, 1996.
[13] N. Snavely, S.M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3D. In SIGGRAPH, pages 835–846, 2006.
[14] Noah Snavely, Steven M. Seitz, and Richard Szeliski. Modeling the world from internet photo collections. International Journal of Computer Vision, 80(2):189–210, 2008.
http://dx.doi.org/10.1007/s11263-007-0107-3
[15] G. Wolberg. Image morphing: a survey. The Visual Computer, 14(8):360–372, 1998.
http://dx.doi.org/10.1007/s003710050148
[16] L. Zebedin, J. Bauer, K. Karner, and H. Bischof. Fusion of feature- and area-based information for urban buildings modeling from aerial imagery. In Eur. Conf. on Computer Vision (ECCV), 2008.
Full Text: PDF