The Impact of Cooperative Perception on Decision Making and Planning of Autonomous Vehicles

In this article, we investigate how cooperative perception gives the impact on decision making and planning of autonomous vehicles on the road. Cooperative perception is the exchange of local sensing information with other vehicles or infrastructures via wireless communications, by which the perception range can be considerably extended up to the boundary of connected vehicles. This augmented perception capability can provide oncoming traffic information beyond line-of-sight and field-of-view, which enables better control of both manned and unmanned vehicles. In this article, we first present an on-road sensing system to provide a see-through/lifted-seat/satellite view to drivers. Then, we investigate how the extended perception capability can contribute to situation awareness on the road. Finally, we provide methods for safer and smoother autonomous driving using the augmented situation awareness and perception capability. All introduced and proposed concepts are implemented and validated on autonomous vehicles.

[1]  Ellen van Nunen,et al.  Cooperative Competition for Future Mobility , 2012, IEEE Transactions on Intelligent Transportation Systems.

[2]  Yevgeni Koucheryavy,et al.  Power Control in See-Through Overtaking Assistance System , 2013, IEEE Communications Letters.

[3]  Marcelo H. Ang,et al.  Vehicle motion intention reasoning using cooperative perception on urban road , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[4]  William B. Dunbar,et al.  Cooperative driving: Beyond V2V as an ADAS sensor , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[5]  Fawzi Nashashibi,et al.  Multi-vehicle cooperative perception and augmented reality for driver assistance: A possibility to ‘see’ through front vehicle , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[6]  S Kato,et al.  An architecture for cooperative driving of automated vehicles , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[7]  Yevgeni Koucheryavy,et al.  The Use of Automotive Radars in Video-Based Overtaking Assistance Applications , 2013, IEEE Transactions on Intelligent Transportation Systems.

[8]  Han-Shue Tan,et al.  DGPS-Based Vehicle-to-Vehicle Cooperative Collision Warning: Engineering Feasibility Viewpoints , 2006, IEEE Transactions on Intelligent Transportation Systems.

[9]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[10]  Lucia Lo Bello,et al.  Automotive communications-past, current and future , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[11]  Ljubo B. Vlacic,et al.  Cooperative Autonomous Driving at the Intelligent Control Systems Laboratory , 2003, IEEE Intell. Syst..

[12]  Emilio Frazzoli,et al.  Multiple vehicle driving control for traffic flow efficiency , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[13]  Henk Wymeersch,et al.  Design and Experimental Validation of a Cooperative Driving System in the Grand Cooperative Driving Challenge , 2012, IEEE Transactions on Intelligent Transportation Systems.

[14]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[15]  Fawzi Nashashibi,et al.  Cooperative Multi-Vehicle Localization Using Split Covariance Intersection Filter , 2013, IEEE Intelligent Transportation Systems Magazine.

[16]  Kuo-Yun Liang,et al.  The Development of a Cooperative Heavy-Duty Vehicle for the GCDC 2011: Team Scoop , 2012, IEEE Transactions on Intelligent Transportation Systems.

[17]  Seung-Woo Seo,et al.  Cooperative Unmanned Autonomous Vehicle Control for Spatially Secure Group Communications , 2012, IEEE Journal on Selected Areas in Communications.

[18]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[19]  E. Frazzoli,et al.  Utilizing the infrastructure to assist autonomous vehicles in a mobility on demand context , 2012, TENCON 2012 IEEE Region 10 Conference.

[20]  Ulf Holmberg,et al.  A Modular CACC System Integration and Design , 2012, IEEE Transactions on Intelligent Transportation Systems.

[21]  Emilio Frazzoli,et al.  Anytime Motion Planning using the RRT* , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Paul D. Alexander,et al.  Cooperative Intelligent Transport Systems: 5.9-GHz Field Trials , 2011, Proceedings of the IEEE.

[23]  Cristina Olaverri-Monreal,et al.  Making Vehicles Transparent Through V2V Video Streaming , 2012, IEEE Transactions on Intelligent Transportation Systems.

[24]  Marcelo H. Ang,et al.  Motion planning using cooperative perception on urban road , 2013, 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[25]  Marcelo H. Ang,et al.  Incremental sampling-based algorithm for risk-aware planning under motion uncertainty , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Cristina Olaverri-Monreal,et al.  The See-Through System: A VANET-enabled assistant for overtaking maneuvers , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[27]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[28]  Michel Parent,et al.  Cooperative autonomous driving: intelligent vehicles sharing city roads , 2005, IEEE Robotics & Automation Magazine.

[29]  Seung-Woo Seo,et al.  King's Graph-Based Neighbor-Vehicle Mapping Framework , 2013, IEEE Transactions on Intelligent Transportation Systems.

[30]  Luca Delgrossi,et al.  IEEE 802.11p: Towards an International Standard for Wireless Access in Vehicular Environments , 2008, VTC Spring 2008 - IEEE Vehicular Technology Conference.

[31]  Gaurav S. Sukhatme,et al.  Putting the 'I' in 'team': an ego-centric approach to cooperative localization , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[32]  Martin Lauer,et al.  Team AnnieWAY's Entry to the 2011 Grand Cooperative Driving Challenge , 2012, IEEE Transactions on Intelligent Transportation Systems.

[33]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[34]  Yevgeni Koucheryavy,et al.  An Overtaking Assistance System Based on Joint Beaconing and Real-Time Video Transmission , 2012, IEEE Transactions on Vehicular Technology.

[35]  Aníbal Ollero,et al.  A cooperative perception system for multiple UAVs: Application to automatic detection of forest fires , 2006, J. Field Robotics.

[36]  Henk Nijmeijer,et al.  Cooperative Driving With a Heavy-Duty Truck in Mixed Traffic: Experimental Results , 2012, IEEE Transactions on Intelligent Transportation Systems.

[37]  Emilio Frazzoli,et al.  Multivehicle Cooperative Driving Using Cooperative Perception: Design and Experimental Validation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[38]  Alberto Broggi,et al.  Extensive Tests of Autonomous Driving Technologies , 2013, IEEE Transactions on Intelligent Transportation Systems.

[39]  O. Mano,et al.  Forward collision warning with a single camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[40]  Fawzi Nashashibi,et al.  Multivehicle Cooperative Local Mapping: A Methodology Based on Occupancy Grid Map Merging , 2014, IEEE Transactions on Intelligent Transportation Systems.

[41]  D. de Bruin,et al.  Design and test of a cooperative adaptive cruise control system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[42]  Vicente Milanés Montero,et al.  Cooperative Adaptive Cruise Control in Real Traffic Situations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[43]  Bilin Aksun Güvenç,et al.  Cooperative Adaptive Cruise Control Implementation of Team Mekar at the Grand Cooperative Driving Challenge , 2012, IEEE Transactions on Intelligent Transportation Systems.