Speed-adaptive street view image generation using driving video recorder

With the rapid development and reduced cost of digital video capturing devices, driving video recorders (DVRs) begin to gain widespread popularity. What is seen and what happens along the way can thus be recorded in videos. However, searching for a specific scene or event among such massive video collections is laborious and tedious. In this paper, we develop a speed-adaptive street view image generation system using general front-mounted DVRs, requiring no additional devices deployed. Visual summaries of street scenes along the way can be provided, allowing users to retrieve a video clip corresponding to a specific road section quickly. An efficient algorithm for estimating the distance a pixel has moved between two consecutive frames is also proposed, so a street view image can be generated with an appropriate aspect ratio without demanding a constant driving speed. Experiments on an extensive data set show that our proposed system can efficiently generate street view images under different lighting and weather conditions, demonstrating its feasibility.

[1]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[2]  Luc Vincent,et al.  Taking Online Maps Down to Street Level , 2007, Computer.

[3]  Luc Van Gool,et al.  Fast Compact City Modeling for Navigation Pre-Visualization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Shmuel Peleg,et al.  Minimal Aspect Distortion (MAD) Mosaicing of Long Scenes , 2008, International Journal of Computer Vision.

[5]  Jana Kosecka,et al.  Piecewise planar city 3D modeling from street view panoramic sequences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Michal Havlena,et al.  From Google Street View to 3D city models , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[7]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, ACM Trans. Graph..

[8]  Richard Szeliski,et al.  Street slide: browsing street level imagery , 2010, ACM Trans. Graph..

[9]  C. Pendleton The World According to Bing , 2010, IEEE Computer Graphics and Applications.

[10]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[11]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, SIGGRAPH 2006.

[12]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[13]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[14]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..