Visualizing driving video in temporal profile

Nowadays, many vehicles are equipped with a vehicle borne camera system for monitoring drivers' behavior, accident investigation, road environment assessment, and vehicle safety design. Huge amount of video data is being recorded daily. Analyzing and interpreting these data in an efficient way has become a non-trivial task. As an index of video for quick browsing, this work maps the video into a temporal image of reduced dimension with as much intrinsic information as possible observed on the road. The perspective projection video is converted to a top-view temporal profile that has precise time, motion, and event information during the vehicle driving. Then, we attempt to interpret dynamic events and environment around the vehicle in such a continuous and compact temporal profile. The reduced dimension of the temporal profile allows us to browse the video intuitively and efficiently.

[1]  Richard Szeliski,et al.  Street slide: browsing street level imagery , 2010, ACM Trans. Graph..

[2]  Jiang Yu Zheng,et al.  Towards collision alarming based on visual motion , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[3]  Siwei Luo,et al.  Railroad online: acquiring and visualizing route panoramas of rail scenes , 2013, The Visual Computer.

[4]  Saburo Tsuji,et al.  Generating Dynamic Projection Images for Scene Representation and Understanding , 1998, Comput. Vis. Image Underst..

[5]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[7]  Jiang Yu Zheng,et al.  Scanning Depth of Route Panorama Based on Stationary Blur , 2008, International Journal of Computer Vision.

[8]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[11]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yu Zhou,et al.  Scanning scene tunnel for city traversing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[13]  Allen R. Hanson,et al.  Generalized parallel-perspective stereo mosaics from airborne video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Alexander Zelinsky,et al.  Robust vision based lane tracking using multiple cues and particle filtering , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[15]  Hiromi T. Tanaka,et al.  Acquiring shaking-free route panorama by stationary blurring , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Jiang Yu Zheng.  Digital Route Panoramas , 2003, IEEE Multim..

[17]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.