A Cognitively Inspired System Architecture for the Mengshi Cognitive Vehicle

This paper introduces the functional system architecture of the Mengshi intelligent vehicle, winner of the 2018 World Intelligent Driving Challenge (WIDC). Different from traditional smart vehicles, a cognitive module is introduced in the system architecture to realise the transition from perception to decision-making. This is shown to enhance the practical utility of the smart vehicle, enabling safe and robust driving in different scenes. The collaborative work of hardware and software systems is achieved through multi-sensor fusion and artificial intelligence (AI) technologies, including novel use of deep machine learning and context-aware scene analysis to select optimal driving strategies. Experimental results using both robustness tests and road tests confirm that the Mengshi intelligent vehicle is reliable and robust in challenging environments. This paper describes the major components of this cognitively inspired architecture and discusses the results of the 2018 WIDC.

[1]  Klaus Henning,et al.  The "cognitive car": A roadmap for research issues in the automotive sector , 2006, Annu. Rev. Control..

[2]  Hong Qiao,et al.  Cross-modality interactive attention network for multispectral pedestrian detection , 2019, Inf. Fusion.

[3]  Danilo Comminiello,et al.  Group sparse regularization for deep neural networks , 2016, Neurocomputing.

[4]  Nanning Zheng,et al.  Brain-Inspired Cognitive Model With Attention for Self-Driving Cars , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[5]  Zdzislaw Kowalczuk,et al.  Autonomous Driver Based on an Intelligent System of Decision-Making , 2015, Cognitive Computation.

[6]  Marco Beccuti,et al.  Cognitive systems in intelligent vehicles - a new frontier for autonomous driving , 2014, 2014 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[7]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[8]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[9]  Hong Qiao,et al.  Guided Policy Search for Sequential Multitask Learning , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Erfu Yang,et al.  A Biologically Inspired Vision-Based Approach for Detecting Multiple Moving Objects in Complex Outdoor Scenes , 2015, Cognitive Computation.

[11]  Shahriar Gharibzadeh,et al.  Human Brain Function in Path Planning: a Task Study , 2017, Cognitive Computation.

[12]  Xinyu Zhang,et al.  A study on key technologies of unmanned driving , 2016, CAAI Trans. Intell. Technol..

[13]  Chuanqi Tan,et al.  Object Detection Based on Hierarchical Multi-view Proposal Network for Autonomous Driving , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[14]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[15]  Amir Hussain,et al.  Applications of Deep Learning and Reinforcement Learning to Biological Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Y. Song,et al.  Conjugate Unscented FastSLAM for Autonomous Mobile Robots in Large-Scale Environments , 2014, Cognitive Computation.

[17]  Nanning Zheng,et al.  Cognitive Cars: A New Frontier for ADAS Research , 2012, IEEE Transactions on Intelligent Transportation Systems.

[18]  Fuchun Sun,et al.  Robotic Room-Level Localization Using Multiple Sets of Sonar Measurements , 2017, IEEE Transactions on Instrumentation and Measurement.

[19]  Zhuoping Yu Dynamic Control for Unmanned Skid-steering Vehicle with Conditional Integartors , 2017 .

[20]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.