Comparing Hand Gesture Vocabularies for HCI

HCI systems are often equipped with gestural interfaces drawing on a predefined set of admitted gestures. We provide an assessment of the fitness of such gesture vocabularies in terms of their learnability and naturalness. This is done by example of rivaling gesture vocabularies of the museum information system WikiNect. In this way, we do not only provide a procedure for evaluating gesture vocabularies, but additionally contribute to design criteria to be followed by the gestures.

[1]  Yael Edan,et al.  A Method for Selection of Optimal Hand Gesture Vocabularies , 2009, Gesture Workshop.

[2]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. Burks.  Icon, Index, and Symbol , 1949 .

[4]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[5]  Shih-Fu Chang,et al.  A conceptual framework and empirical research for classifying visual descriptors , 2001, J. Assoc. Inf. Sci. Technol..

[6]  Isabella Poggi.  Iconicity in different types of gestures , 2008 .

[7]  Sukeshini A. Grandhi,et al.  Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces , 2011, CHI.

[8]  Stefan Kopp,et al.  Data-based analysis of speech and gesture: the Bielefeld Speech and Gesture Alignment corpus (SaGA) and its applications , 2013, Journal on Multimodal User Interfaces.

[9]  M. Newman.  Power laws, Pareto distributions and Zipf's law , 2005 .

[10]  Peter Nijkamp,et al.  Accessibility of Cities in the Digital Economy , 2004, cond-mat/0412004.

[11]  George Kingsley Zipf,et al.  Human Behaviour and the Principle of Least Effort: an Introduction to Human Ecology , 2012 .

[12]  Rashid Ansari,et al.  Multimodal human discourse: gesture and speech , 2002, TCHI.

[13]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[14]  Alexander Mehler,et al.  WikiNect: towards a gestural writing system for kinetic museum wikis , 2012, UXeLATE '12.

[15]  Lada A. Adamic.  Zipf, Power-laws, and Pareto-a ranking tutorial , 2000 .

[16]  Micha Elsner,et al.  Wally Referring Expression Corpus (WREC) v0.1.0 , 2013 .

[17]  Alexander Mehler,et al.  WikiNect: image schemata as a basis of gestural writing for kinetic museum wikis , 2015, Universal Access in the Information Society.

[18]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .