Inertial-Based Gesture Recognition for Artificial Intelligent Cockpit Control using Hidden Markov Models

Driving a car is no longer just a means to get around quickly. Currently, driving itself has become an entertainment factor with steadily increasing occupant safety. This is ensured by a multitude of safety and comfort features, such as various driver assistance systems and innovative control options within the cockpit. The content of this paper introduces a new way to cockpit operation, which contributes to the increase of user comfort. For gesture recognition of the occupant low-cost inertial sensors on a bracelet are used. Due to the relatively poor sensor performance, complex analysis algorithms are needed. For this purpose, the implementation of Hidden Markov models for the establishment of an artificially intelligent data analysis system is suitable. The present work is based on past research results performed at the CCASS, which provided a framework for reference-less human motion analysis and validation using low-cost inertial motion sensors. The developed algorithms are based on the theory of Hidden Markov Models for the stochastic modelling of human motion using Markov chains. In the present work the algorithm will be adapted to a concept of gesture recognition for cockpit control.

[1]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  N. Berezowski,et al.  P6.1 - Reference-less Human Motion Recognition using MEMSbased inertial motion sensors and stochastic signal modelling , 2015 .

[3]  Hao Wang,et al.  An Adaptive Hidden Markov Model for Activity Recognition Based on a Wearable Multi-Sensor Device , 2015, Journal of Medical Systems.

[4]  Mohamed Eltoweissy,et al.  Big data and semantics management system for computer networks , 2017, Ad Hoc Networks.

[5]  Sung-Bae Cho,et al.  Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models , 2017, Int. J. Distributed Sens. Networks.

[6]  Arafat Awajan,et al.  The Use of Hidden Markov Model in Natural ARABIC Language Processing: a survey , 2017, EUSPN/ICTH.

[7]  Nasser M. Nasrabadi,et al.  An efficient Euclidean distance computation for vector quantization using a truncated look-up table , 1995, IEEE Trans. Circuits Syst. Video Technol..

[8]  Ozgur pashak Recognizing Human Activities from Sensors Using Hidden Markov Models , 2014 .

[9]  Kichun Lee,et al.  Opinion mining using ensemble text hidden Markov models for text classification , 2018, Expert Syst. Appl..

[10]  G. Schmidt,et al.  Inertial sensor technology trends , 2001 .

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.