Hand features extractor using hand contour – a case study

Hand gesture recognition is an important topic in natural user interfaces (NUI). Hand features extraction is the first step for hand gesture recognition. This work proposes a novel real time method for hand features recognition. In our framework we use three cameras and the hand region is extracted with the background subtraction method. Features like arm angle and fingers positions are calculated using Y variations in the vertical contour image. Wrist detection is obtained by calculating the bigger distance from a base line and the hand contour, giving the main features for the hand gesture recognition. Experiments on our own data-set of about 1800 images show that our method performs well and is highly efficient.

[1]  Juan Pablo Wachs,et al.  Context-based hand gesture recognition for the operating room , 2014, Pattern Recognit. Lett..

[2]  Christianne Falcão,et al.  Evaluation of Natural User Interface: A Usability Study Based on the Leap Motion Device , 2015 .

[3]  R. Yassari,et al.  Use of Google Glass to Enhance Surgical Education of Neurosurgery Residents: "Proof-of-Concept" Study. , 2017, World neurosurgery.

[4]  Malin Premaratne,et al.  Hand gesture tracking and recognition system using Lucas-Kanade algorithms for control of consumer electronics , 2013, Neurocomputing.

[5]  Daniel Sonntag,et al.  Maintain and Improve Mental Health by Smart Virtual Reality Serious Games , 2015, MindCare.

[6]  Yang-Weon Lee.  Implementation of an interactive interview system using hand gesture recognition , 2013, Neurocomputing.

[7]  V. N. Iliukhin,et al.  The Development of Motion Capture System Based on Kinect Sensor and Bluetooth-Gloves ☆ , 2017 .

[8]  Brian C. Lovell,et al.  Hand pose recognition from monocular images by geometrical and texture analysis , 2015, Journal of Visual Languages and Computing.

[9]  Jinsheng Kang,et al.  Instant 3D design concept generation and visualization by real-time hand gesture recognition , 2013, Comput. Ind..

[10]  Haitham Badi.  Recent methods in vision-based hand gesture recognition , 2016, International Journal of Data Science and Analytics.

[11]  Caterina Rizzi,et al.  Mixed Reality to Design Lower Limb Prosthesis , 2015 .

[12]  Ugur Güdükbay,et al.  A hand gesture recognition technique for human-computer interaction , 2015, J. Vis. Commun. Image Represent..

[13]  Francesco Camastra,et al.  Handy: A real-time three color glove-based gesture recognizer with learning vector quantization , 2012, Expert Syst. Appl..

[14]  Alex W Stedmon,et al.  Methodology for evaluating gloves in relation to the effects on hand performance capabilities: a literature review , 2012, Ergonomics.

[15]  Radu-Daniel Vatavu,et al.  On free-hand TV control: experimental results on user-elicited gestures with Leap Motion , 2015, Personal and Ubiquitous Computing.

[16]  Wu-Chih Hu,et al.  Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination , 2011, Expert Syst. Appl..

[17]  Honghai Liu,et al.  Hand posture recognition based on heterogeneous features fusion of multiple kernels learning , 2015, Multimedia Tools and Applications.

[18]  Zhang Ling,et al.  Hand detection based on depth information and color information of the Kinect , 2015, The 27th Chinese Control and Decision Conference (2015 CCDC).

[19]  S. Goldin-Meadow,et al.  Learning from Gesture: How Our Hands Change Our Minds , 2015, Educational Psychology Review.

[20]  Prabin Kumar Bora,et al.  A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments , 2013, Pattern Recognit..

[21]  Tansel Özyer,et al.  Boosting real-time recognition of hand posture and gesture for virtual mouse operations with segmentation , 2015, Applied Intelligence.

[22]  A. Z. Syed,et al.  DARK ROOM TO AUGMENTED REALITY: APPLICATION OF HOLOLENS TECHNOLOGY FOR ORAL RADIOLOGICAL DIAGNOSIS , 2017 .

[23]  Caterina Rizzi,et al.  A virtual environment to emulate tailor’s work , 2016 .

[24]  Kandarpa Kumar Sarma,et al.  Stereo Vision-based Hand Gesture Recognition under 3D Environment , 2015 .

[25]  Amit Gupta,et al.  FPGA based Real Time Human Hand Gesture Recognition System , 2012 .

[26]  Yingli Tian,et al.  Histogram of 3D Facets: A depth descriptor for human action and hand gesture recognition , 2015, Comput. Vis. Image Underst..

[27]  Anand Kannan,et al.  Intelligent System for Human Computer Interface Using Hand Gesture Recognition , 2012 .

[28]  Wang Liang,et al.  Dynamic and combined gestures recognition based on multi-feature fusion in a complex environment , 2015 .

[29]  Hyotaek Lim,et al.  Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware , 2015, Multimedia Tools and Applications.

[30]  Sidney S. Fels,et al.  Transforming a Paper based Process to a Natural user Interfaces Process in a Chronic Care Hospital , 2012, DSAI.

[31]  Gang Hua,et al.  Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields , 2012, Image Vis. Comput..

[32]  Andrea Vitali,et al.  Acquisition of customer’s tailor measurements for 3D clothing design using virtual reality devices , 2018 .

[33]  Hung T. Nguyen,et al.  Human computer interaction using hand gesture , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  Ismail Khalid Kazmi,et al.  Hand gesture-based interactive puppetry system to assist storytelling for children , 2017, The Visual Computer.

[35]  Long Ye,et al.  A Virtual Music Control System Based on Dynamic Hand Gesture Recognition , 2017, Trans. Edutainment.