Gesture Recognition Using mm-Wave Sensor for Human-Car Interface

This article details the development of a gesture recognition technique using a mm-wave radar sensor for in-car infotainment control. Gesture recognition is becoming a more prominent form of humancomputer interaction and can be used in the automotive industry to provide a safe and intuitive control interface that will limit driver distraction. We use a 60 GHz mm-wave radar sensor to detect precise features of fine motion. Specific gesture features are extracted and used to build a machine learning engine that can perform real-time gesture recognition. This article discusses the user requirements and in-car environmental constraints that influenced design decisions. Accuracy results of the technique are presented, and recommendations for further research and improvements are made.

[1]  Lale Akarun,et al.  Real time hand pose estimation using depth sensors , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  Mohan M. Trivedi,et al.  Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[3]  Uli Reissner Gestures and Speech in Cars , 2007 .

[4]  Pavlo Molchanov,et al.  Short-range FMCW monopulse radar for hand-gesture sensing , 2015, 2015 IEEE Radar Conference (RadarCon).

[5]  Pavlo Molchanov,et al.  Multi-sensor system for driver's hand-gesture recognition , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[6]  Alois Ferscha,et al.  Natural DVI based on intuitive hand gestures , 2011 .

[7]  Fabien Moutarde,et al.  Hand gesture recognition for driver vehicle interaction , 2015, CVPR 2015.

[8]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[9]  Keith J. Burnham,et al.  A Research Study of Hand Gesture Recognition Technologies and Applications for Human Vehicle Interaction , 2007 .

[10]  Santosh Naik A Study on Automotive Human Vehicle Interaction Using Gesture Recognition Technology , 2012 .

[11]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Katja Kircher,et al.  Driver distraction : a review of the literature , 2007 .

[13]  Micah Alpern,et al.  Developing a car gesture interface for use as a secondary task , 2003, CHI Extended Abstracts.

[14]  Stefan Müller,et al.  Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera-A Pilot Study , 2007, MIRAGE.