Voting-based Hand-Waving Gesture Spotting from a Low-Resolution Far-Infrared Image Sequence

We propose a temporal spotting method of a hand gesture from a low-resolution far-infrared image sequence captured by a far-infrared sensor array. The sensor array captures the spatial distribution of far-infrared intensity as a thermal image by detecting far-infrared waves emitted from heat sources. It is difficult to spot a hand gesture from a sequence of thermal images captured by the sensor due to its low-resolution, heavy noise, and varying duration of the gesture. Therefore, we introduce a voting-based approach to spot the gesture with template matching-based gesture recognition. We confirm the effectiveness of the proposed temporal spotting method in several settings.

[1]  Tatsuya Fujii,et al.  Gesture recognition system for Human-Robot Interaction and its application to robotic service task , 2014 .

[2]  Mohamed Alsheakhali,et al.  Hand Gesture Recognition System , 2011 .

[3]  I. Shimoyama,et al.  Micro mirror arrays for improved sensitivity of thermopile infrared sensors , 2011, 2011 IEEE 24th International Conference on Micro Electro Mechanical Systems.

[4]  Hiroshi Murase,et al.  Human Tracking Using a Far-Infrared Sensor Array and a Thermo-Spatial Sensitive Histogram , 2014, ACCV Workshops.

[5]  Kenji Terabayashi,et al.  Gesture recognition based on the detection of periodic motion , 2010, 2010 International Symposium on Optomechatronic Technologies.

[6]  Hiroshi Murase,et al.  Hand Waving Gesture Detection using a Far-infrared Sensor Array with Thermo-spatial Region of Interest , 2016, VISIGRAPP.

[7]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Hiroshi Murase,et al.  Action recognition from extremely low-resolution thermal image sequence , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).