Modeling for gesture set design toward realizing effective human-vehicle interface

Intuitive driver-to-vehicle interface is highly desirable as we experience rapid increase of vehicle device complexity in modern day automobile. This paper addresses the gesture mode of interface and proposes an effective gesture language set capable of providing automotive control via hand gesture as natural but safe human-vehicle interface. Gesture language set is designed based on practical motions of single hand gesture. Proposed language set is optimized for in-vehicle imaging environment. Feature mapping for recognition is achieved using hidden Markov model which effectively captures the hand motion descriptors. Representative experimental results indicate that the recognition performance of proposed language set is over 99%, which makes it promising for real vehicle application.

[1]  L. Baum,et al.  An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process , 1972 .

[2]  Dariu Gavrila,et al.  Sensor-Based Pedestrian Protection , 2001, IEEE Intell. Syst..

[3]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-based continuous gesture recognition system for hand motion trajectory , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Hanseok Ko,et al.  Hand Motion Design for Performance Enhancement of Vision Based Hand Signal Recognizer , 2011 .

[5]  Hermann Ney,et al.  Speech recognition techniques for a sign language recognition system , 2007, INTERSPEECH.

[6]  Micah Alpern,et al.  Developing a car gesture interface for use as a secondary task , 2003, CHI Extended Abstracts.

[7]  Ulrich Neumann,et al.  Real-time Hand Pose Recognition Using Low-Resolution Depth Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Hanseok Ko,et al.  Robot User Control System using Hand Gesture Recognizer , 2011 .

[9]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  Nianjun Liu,et al.  Model structure selection & training algorithms for an HMM gesture recognition system , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[11]  Christian Sandor,et al.  Experimental evaluation of an augmented reality visualization for directing a car driver's attention , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  N S Seixas,et al.  A review of crane safety in the construction industry. , 2001, Applied occupational and environmental hygiene.

[14]  Thomas Kalinke,et al.  An image processing system for driver assistance , 2000, Image Vis. Comput..

[15]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[16]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  A. Bouzerdoum,et al.  A Bayesian approach to skin color classification in YCbCr color space , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[18]  Fumiaki Tomita,et al.  System and Evaluation , 1990 .

[19]  Dimitris N. Metaxas,et al.  Parallel hidden Markov models for American sign language recognition , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.