Agent Architecture for Adaptive Behaviors in Autonomous Driving

Evolution has endowed animals with outstanding adaptive behaviours which are grounded in the organization of their sensorimotor system. This paper uses inspiration from these principles of organization in the design of an artificial agent for autonomous driving. After distilling the relevant principles from biology, their functional role in the implementation of an artificial system are explained. The resulting Agent, developed in an EU H2020 Research and Innovation Action, is used to concretely demonstrate the emergence of adaptive behaviour with a significant level of autonomy. Guidelines to adapt the same principled organization of the sensorimotor system to other agents for driving are also obtained. The demonstration of the system abilities is given with example scenarios and open access simulation tools. Prospective developments concerning learning via mental imagery are finally discussed.

[1]  Alice Plebe,et al.  On Reliable Neural Network Sensorimotor Control in Autonomous Vehicles , 2020, IEEE Transactions on Intelligent Transportation Systems.

[2]  Mauro Da Lio,et al.  Dreaming Mechanism for Training Bio-Inspired Driving Agents , 2019, IHSI.

[3]  Kevin Gurney,et al.  Multi-alternative decision-making with non-stationary inputs , 2016, Royal Society Open Science.

[4]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[5]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[6]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[7]  David M. Kaplan,et al.  Topographic organization in the brain: searching for general principles , 2014, Trends in Cognitive Sciences.

[8]  David Windridge,et al.  Artificial Co-Drivers as a Universal Enabling Technology for Future Intelligent Vehicles and Transportation Systems , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Emilio Frazzoli,et al.  RRTX: Real-Time Motion Planning/Replanning for Environments with Unpredictable Obstacles , 2014, WAFR.

[10]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[11]  Keith L. Downing,et al.  Predictive models in the brain , 2009, Connect. Sci..

[12]  A. Damasio,et al.  Convergence and divergence in a neural architecture for recognition and memory , 2009, Trends in Neurosciences.

[13]  G. Pezzulo,et al.  Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition , 2016, Trends in Cognitive Sciences.

[14]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[15]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  David Windridge,et al.  Exploiting dream-like simulation mechanisms to develop safer agents for automated driving: The “Dreams4Cars” EU research and innovation action , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[17]  Alberto Broggi,et al.  PROUD-Public road urban driverless test: Architecture and results , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[18]  David Windridge,et al.  On the utility of dreaming: A general model for how learning in artificial agents can benefit from data hallucination , 2020, Adapt. Behav..

[19]  Kevin R. Peters,et al.  Different roles for REM and stage 2 sleep in motor learning: A proposed model , 2004 .

[20]  Mauro Da Lio,et al.  Mental Imagery for Intelligent Vehicles , 2019, VEHITS.

[21]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[22]  Christos Katrakazas,et al.  Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions , 2015 .

[23]  Dominique Gruyer,et al.  A Review of Motion Planning for Highway Autonomous Driving , 2020, IEEE Transactions on Intelligent Transportation Systems.

[24]  Mauro Da Lio,et al.  On the Road with 16 Neurons: Mental Imagery with Bio-inspired Deep Neural Networks , 2020, ArXiv.

[25]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[26]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[27]  Serge Thill,et al.  Beyond bodily anticipation: Internal simulations in social interaction , 2016, Cognitive Systems Research.

[28]  W. Davis.  The Ecological Approach to Visual Perception , 2012 .

[29]  Kevin N. Gurney,et al.  A biologically plausible embodied model of action discovery , 2012, Front. Neurorobot..

[30]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour , 2001, Biological Cybernetics.

[31]  三嶋 博之.  The theory of affordances , 2008 .

[32]  Marcelo H. Ang,et al.  Perception, Planning, Control, and Coordination for Autonomous Vehicles , 2017 .

[33]  A. Chemero.  An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.

[34]  Kevin Gurney,et al.  Biologically Guided Driver Modeling: the Stop Behavior of Human Car Drivers , 2018, IEEE Transactions on Intelligent Transportation Systems.

[35]  R. Wurtz,et al.  Composition and topographic organization of signals sent from the frontal eye field to the superior colliculus. , 2000, Journal of neurophysiology.

[36]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[37]  Kevin N. Gurney,et al.  The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions , 2007, Neural Computation.

[38]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[39]  Gilles Montagne,et al.  Drivers' decision-making when attempting to cross an intersection results from choice between affordances , 2015, Front. Hum. Neurosci..

[40]  P. Cisek.  Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.

[41]  G. Marcus,et al.  The topographic brain: from neural connectivity to cognition , 2007, Trends in Neurosciences.

[42]  Dongpu Cao,et al.  A Personalized Behavior Learning System for Human-Like Longitudinal Speed Control of Autonomous Vehicles , 2019, Sensors.

[43]  Gregor Schöner,et al.  Dynamics of behavior: Theory and applications for autonomous robot architectures , 1995, Robotics Auton. Syst..