A Novel Approach to Neural Network-based Motion Cueing Algorithm for a Driving Simulator

Generating realistic motion in a motion-based (dynamic) driving simulator is challenging due to the limited workspace of the motion system of the simulator compared to the motion range of the simulated vehicle. Motion Cueing Algorithms (MCAs) render accelerations by controlling the motion system of the simulators to provide the driver with a realistic driving experience. Commonly used methods such as Classical Washout-based MCA (CW-MCA) typically achieves suboptimal results due to scaling and filtering, which results in an inefficient usage of the workspace. The Model Predictive Control-based MCA (MPC-MCA) has been shown to achieve superior results and more efficient workspace use. However, it's performance is in practice constrained due to the computationally expensive operations and the requirement of an accurate prediction of future vehicle states. Finally, the Optimal Control (OC) has been shown to provide optimal cueing in an open-loop setup wherein the precalculated control signals are re-played to the driver. However, OC cannot be used in real-time with the driver-in-the-loop. Our work introduces a novel Neural Network-based MCA (NN-MCA), which is trained to imitate the behavior of the OC. After training, the NN-MCA provides an approximated model of the OC, which can run in real-time with the driver in-the-loop, while achieving similar quality. The experiments demonstrate the potential of this approach through objective evaluations of the generated motion-cues on the simulator model and the real simulator. A demonstration video for the performance comparison of the CW-MCA, Optimal-Control-based MCA (OC-MCA) and our proposed method is available at http://go.tum.de/708350.

[1]  Zhou Fang,et al.  Tilt thresholds for acceleration rendering in driving simulation , 2017, Simul..

[2]  Meyer Nahon,et al.  Simulator motion-drive algorithms - A designer's perspective , 1990 .

[3]  Marc Bordier,et al.  MPC based motion cueing algorithm : Development and application to the ULTIMATE driving simulator , 2004 .

[4]  J. A. Bryson Optimal control-1950 to 1985 , 1996 .

[5]  S. F. Schmidt,et al.  Motion drive signals for piloted flight simulators , 1970 .

[6]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[7]  L. D. Reid,et al.  Flight simulation motion-base drive algorithms: part 1. Developing and testing equations , 1985 .

[8]  Yunpeng Pan,et al.  Learning Deep Neural Network Control Policies for Agile Off-Road Autonomous Driving , 2017 .

[9]  Li Keqiang,et al.  Driving simulation platform applied to develop driving assistance systems , 2010 .

[10]  Kuang-Hua Chang Chapter 8 – Motion Analysis , 2015 .

[11]  Karsten Lemmer,et al.  Control of a Dynamic Driving Simulator: Time-Variant Motion Cueing Algorithms and Prepositioning , 2006 .

[12]  Jean-Rémy Chardonnet,et al.  Solving the Constrained Problem in Model Predictive Control Based Motion Cueing Algorithm with a Neural Network Approach , 2018 .

[13]  Håkan Sehammar,et al.  Motion cueing for 3-, 6- and 8- degrees-of-freedom motion systems , 2010 .

[14]  Sergey Levine,et al.  Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Jean-Pierre Colinot,et al.  The New PSA Peugeot-Citroen Advanced Driving Simulator Overall Design and Motion Cue Algorithm , 2007 .

[16]  Saeid Nahavandi,et al.  Future reference prediction in model predictive control based driving simulators , 2016, ICRA 2016.

[17]  D. Angelaki,et al.  Basic and Clinical Aspects of Vertigo and Dizziness How Vestibular Neurons Solve the Tilt/translation Ambiguity Comparison of Brainstem, Cerebellum, and Thalamus , 2022 .

[18]  James M. Rehg,et al.  AutoRally: An Open Platform for Aggressive Autonomous Driving , 2018, IEEE Control Systems.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[21]  Damien Picard,et al.  Approximate model predictive building control via machine learning , 2018 .

[22]  Peter Onesti Verbindung von Human- und Hardware-in-the-Loop-Testing verkürzt Entwicklungszeit , 2009 .

[23]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[24]  Ahmad B. Rad,et al.  Identification and control of continuous-time nonlinear systems via dynamic neural networks , 2003, IEEE Trans. Ind. Electron..

[25]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[26]  Allan Pinkus,et al.  Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function , 1991, Neural Networks.

[27]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[28]  M. Alonso,et al.  Driving simulation study for the analysis of distraction effects in longitudinal driving behaviour , 2012, Cognition, Technology & Work.