People as Sensors: Imputing Maps from Human Actions

Despite growing attention in autonomy, there are still many open problems, including how autonomous vehicles will interact and communicate with other agents, such as human drivers and pedestrians. Unlike most approaches that focus on pedestrian detection and planning for collision avoidance, this paper considers modeling the interaction between human drivers and pedestrians and how it might influence map estimation, as a proxy for detection. We take a mapping inspired approach and incorporate people as sensors into mapping frameworks. By taking advantage of other agents' actions, we demonstrate how we can impute portions of the map that would otherwise be occluded. We evaluate our framework in human driving experiments and on real-world data, using occupancy grids and landmark-based mapping approaches. Our approach significantly improves overall environment awareness and outperforms standard mapping techniques.

[1]  Emilio Frazzoli,et al.  Intention-Aware Pedestrian Avoidance , 2012, ISER.

[2]  John K. Tsotsos,et al.  Agreeing to cross: How drivers and pedestrians communicate , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[3]  Nicolas Guéguen,et al.  A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing , 2015 .

[4]  Mohan M. Trivedi,et al.  Tactical driver behavior prediction and intent inference: A review , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[6]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  John K. Tsotsos,et al.  Joint Attention in Autonomous Driving (JAAD) , 2016, ArXiv.

[8]  Andreas Birk,et al.  Merging Occupancy Grid Maps From Multiple Robots , 2006, Proceedings of the IEEE.

[9]  Changxu Wu,et al.  The estimation of vehicle speed and stopping distance by pedestrians crossing streets in a naturalistic traffic environment , 2015 .

[10]  Florian Heiss,et al.  Discrete Choice Methods with Simulation , 2016 .

[11]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[12]  S. Shankar Sastry,et al.  Experimental Design for Human-in-the-Loop Driving Simulations , 2014, ArXiv.

[13]  Ruzena Bajcsy,et al.  Integrating Intuitive Driver Models in Autonomous Planning for Interactive Maneuvers , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Ruzena Bajcsy,et al.  Identifying Modes of Intent from Driver Behaviors in Dynamic Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[15]  Hans P. Moravec,et al.  Robot Evidence Grids. , 1996 .

[16]  Ruzena Bajcsy,et al.  Semiautonomous Vehicular Control Using Driver Modeling , 2014, IEEE Transactions on Intelligent Transportation Systems.

[17]  Bilin Aksun Güvenç,et al.  Elastic band based pedestrian collision avoidance using V2X communication , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[18]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[19]  Ding Zhao,et al.  Evaluation of automated vehicles encountering pedestrians at unsignalized crossings , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[20]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[21]  Nagui M Rouphail,et al.  Event-Based Modeling of Driver Yielding Behavior to Pedestrians at Two-Lane Roundabout Approaches , 2013, Transportation research record.

[22]  Eduardo Mario Nebot,et al.  Improving computational and memory requirements of simultaneous localization and map building algorithms , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[23]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.