Integrating gesture-based identification in context-aware applications: a system approach

Gestures contain enough information to distinguish a person from another. This `biometric' feature is the basis of the Kinect-enabled system described in this paper, which is designed to identify a given person through a short chain of in-air gestures (2-3 ones). The user-dependent (trainable) system relies on a traditional Dynamic Time Warping classification algorithm. This core algorithm enhances its performance thanks to two filters (duration and sensitivity) that make the system more robust against the variability of the gestures from the same user among iterations (e.g. gestures may differ in duration and shape). The system includes a `point-based' score strategy designed to rapidly discard the non-probable users and to speed up identity confirmation among the most probable candidates. Additionally, the system includes a specific component to guarantee the training quality. In order to integrate the identification process into a real service, the gesture chain is retrieved through a sequence of double-option questions that aim at better adapting a smart space (the lighting infrastructure and the available multimedia contents) to a given user depending on his specific needs. This way, the identification task remains in second plane, wrapped in functional questions. Ten users have tested the service, providing their positive feedback.

[1]  Abu Saleh Md. Mahfujur Rahman,et al.  Motion-path based gesture interaction with smart home services , 2009, ACM Multimedia.

[2]  Radu-Daniel Vatavu,et al.  User-defined gestures for free-hand TV control , 2012, EuroITV.

[3]  Ana M. Bernardos,et al.  A gesture-enabled method for natural identification in smart spaces , 2013, Proceedings of the 16th International Conference on Information Fusion.

[4]  Aaron E. Rosenberg,et al.  Performance tradeoffs in dynamic time warping algorithms for isolated word recognition , 1980 .

[5]  Jani Mäntyjärvi,et al.  Accelerometer-based gesture control for a design environment , 2006, Personal and Ubiquitous Computing.

[6]  Janusz Konrad,et al.  Dynamic time warping for gesture-based user identification and authentication with Kinect , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Alex Waibel,et al.  Readings in speech recognition , 1990 .

[8]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[9]  W. Marsden I and J , 2012 .

[10]  Jason I. Hong,et al.  Wave to me: user identification using body lengths and natural gestures , 2014, CHI.

[11]  Juan A. Besada,et al.  A gesture-based method for natural interaction in smart spaces , 2015, J. Ambient Intell. Smart Environ..

[12]  Helman Stern,et al.  User Identification for Home Entertainment Based on Free-Air Hand Motion Signatures , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[14]  Joze Guna,et al.  Intuitive gesture based user identification system , 2012, 2012 35th International Conference on Telecommunications and Signal Processing (TSP).

[15]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[16]  Monique W. M. Jaspers,et al.  A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence , 2009, Int. J. Medical Informatics.