Detección y seguimiento de palmas y puntas de los dedos en tiempo real basado en imágenes de profundidad para aplicaciones interactivas

This paper presents a method to detect the fingertips and palm from a human hand from depth images. The palm and fingertip detection is performed via morphological analysis of the extracted hand region, that is, distance transform and an analysis of an inscribed skeleton in the depth image. The proposed method is intended to be used in interactive applications, such as video games, or Human Computer Interaction applications. We developed a 3D digital sculpting video game that uses the proposed method.

[1]  Richard Bowden,et al.  Multi-touchless: Real-time fingertip detection and tracking using geodesic maxima , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[2]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[3]  Takashi Kanai,et al.  A Robust and Centered Curve Skeleton Extraction from 3D Point Cloud , 2012 .

[4]  Antonis A. Argyros,et al.  Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints , 2011, 2011 International Conference on Computer Vision.

[5]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[6]  Ankit Chaudhary,et al.  Fingertip Detection: A Fast Method with Natural Hand , 2012, ArXiv.

[7]  M. H. Heycock,et al.  Papers , 1971, BMJ : British Medical Journal.

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  Javier Ruiz Hidalgo,et al.  Real-Time Head and Hand Tracking Based on 2.5D Data , 2012 .

[10]  Bodo Rosenhahn,et al.  Hand Pose Estimation from a Single RGB-D Image , 2013, ISVC.

[11]  Yu Youling,et al.  Finger Tracking and Gesture Recognition with Kinect , 2012, 2012 IEEE 12th International Conference on Computer and Information Technology.

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  Daniel Cohen-Or,et al.  Curve skeleton extraction from incomplete point cloud , 2009, ACM Trans. Graph..

[14]  Yi Li,et al.  Hand gesture recognition using Kinect , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering.

[15]  Antonis A. Argyros,et al.  Tracking the articulated motion of two strongly interacting hands , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Octavio Navarro-Hinojosa,et al.  DBSCAN modificado con Octrees para agrupar nubes de puntos en tiempo real , 2016, Res. Comput. Sci..

[17]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[18]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[19]  Daniel Thalmann,et al.  3D fingertip and palm tracking in depth image sequences , 2012, ACM Multimedia.