Steering in Video-Based Driving Simulation with Stereo Depth Maps: Dynamic Perspective Corrections

This paper describes a video-based driving simulator that allows the user to steer through a video sequence acquired by a mobile mapping system. This mapping system acquired geotagged stereo video at a rate of 10 Hz. The video data were collected from a standard vehicle, which was driven along a road under normal road conditions. With the use of the stereo image data, a method that allowed a participant to steer through a video was implemented. An experiment to assess a driver's response to this steering is presented. Drivers were found to respond to the geometry of the video sequence by steering left or right when expected.

[1]  Geert Wets,et al.  Proactive Evaluation of Traffic Signs Using a Traffic Sign Simulator , 2015, European Journal of Transport and Infrastructure Research.

[2]  Matthew Rizzo,et al.  Effects of a Controlled Auditory–Verbal Distraction Task on Older Driver Vehicle Control , 2004 .

[3]  Jeff Allen Greenberg,et al.  Effects of Adaptive Lane Departure Warning System on Driver Response to a Surprise Event , 2010 .

[4]  Charles Markham,et al.  Replicating reality: Driver assessment using dual-fidelity simulator , 2013 .

[5]  M L Cook,et al.  A Short History of Driving Simulation , 2011 .

[6]  H. Kawasaki,et al.  A photo-realistic driving simulation system for mixed-reality traffic experiment space , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[7]  William H. Levison,et al.  On-Road Versus Simulator Data in Driver Model Development Driver Performance Model Experience , 2002 .

[8]  Catherine Deegan,et al.  Assessment of stereo camera calibration techniques for a portable mobile mapping system , 2013, IET Comput. Vis..

[9]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[10]  Katsushi Ikeuchi,et al.  Real-time image-based rendering system for virtual city based on image compression technique and eigen texture method , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  Alexander Pollatsek,et al.  Risk Perception Training for Novice Drivers: Evaluating Duration of Effects of Training on a Driving Simulator , 2006 .

[12]  M L Cook,et al.  Simulator Fidelity and Validity in a Transfer-of-Training Context , 2010 .

[13]  Charles Markham,et al.  STEERABLE VIDEO: GENERATING VIDEO-BASED ENVIRONMENTS FOR DRIVING SIMULATION , 2014 .

[14]  Yasser Hassan,et al.  Desirable Spiral Length Based on Driver Steering Behavior , 2009 .

[15]  Tarek Sayed,et al.  Insight into Steering Adaptation Patterns in a Driving Simulator , 2010 .

[16]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[17]  Mark Wentink,et al.  Effect of Simulator Motion Cuing on Steering Control Performance , 2010 .

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  J. Hulley,et al.  Parkinson's disease and driving ability. , 1990, Journal of neurology, neurosurgery, and psychiatry.

[20]  Jacques Droulez,et al.  Role of steering wheel feedback on driver performance: driving simulator and modeling analysis , 2007 .

[21]  Mathieu Brédif Image-Based Rendering of LOD1 3D City Models for traffic-augmented Immersive Street-view Navigation , 2013 .

[22]  Andrew Murray,et al.  Identification of Driver Steering and Speed Control , 2006 .

[23]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[24]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..