Seeing through the Kinect: A Survey on Heuristics for Building Natural User Interfaces Environments

The idea of interacting with technologies through touch-less and body-based interfaces has caused great excitement amongst users, but for the designers it has created various new challenges. Usability encompasses part of these challenges, and there have been attempts at creating heuristics for NUIs design. However, most of these heuristics consider using a device such as Kinect for the recognition of gestures, not people or objects. Therefore, in this paper we investigate the subject by presenting a systematic literature review aimed at finding heuristics for the design and evaluation of NUIs. Our analysis focuses on the scenario of helping people with visual disabilities in their daily activities. By looking at the state of the art, we intend to verify how many and which heuristics fit in this context.

[1]  Gregory Goth.  Brave NUI world , 2011, CACM.

[2]  Raimund Dachselt,et al.  Diagram Editing on Interactive Displays Using Multi-touch and Pen Gestures , 2010, Diagrams.

[3]  Karsten Nebe,et al.  Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction , 2011, HCI.

[4]  Emre Ertin,et al.  An unobtrusively wearable sensor suite for inferring the onset, causality, and consequences of stress in the field , 2011, SenSys.

[5]  Stefan Decker,et al.  A dual-mode user interface for accessing 3D content on the world wide web , 2012, WWW.

[6]  Daniel J. Wigdor,et al.  FlowBlocks: a multi-touch ui for crowd interaction , 2012, UIST.

[7]  Adrian David Cheok,et al.  Transactions on Edutainment VIII , 2012, Lecture Notes in Computer Science.

[8]  Volker Paelke,et al.  A Taxonomy-Based Approach towards NUI Interaction Design , 2013, HCI.

[9]  Maurizio Tucci,et al.  A gestural approach to presentation exploiting motion capture metaphors , 2012, AVI.

[10]  Joonhwan Lee,et al.  Hands-up: motion recognition using kinect and a ceiling to improve the convenience of human life , 2012, CHI EA '12.

[11]  Jakob Nielsen,et al.  Chapter 6 – Usability Testing , 1993 .

[12]  Franca Garzotto,et al.  Touchless gestural interaction with small displays: a case study , 2013, CHItaly '13.

[13]  Carlos Jensen,et al.  An evaluation of game controllers and tablets as controllers for interactive tv applications , 2012, ICMI '12.

[14]  Nasir D. Memon,et al.  Biometric-rich gestures: a novel approach to authentication on multi-touch devices , 2012, CHI.

[15]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[16]  Yi-Ping Hung,et al.  AirTouch panel: a re-anchorable virtual touch panel , 2013, MM '13.

[17]  Andrea Sanna,et al.  A kinect-based interface to animate virtual characters , 2012, Journal on Multimodal User Interfaces.

[18]  Kenton O'Hara,et al.  On the naturalness of touchless: Putting the “interaction” back into NUI , 2013, TCHI.

[19]  Marco Brambilla,et al.  A revenue sharing mechanism for federated search and advertising , 2012, WWW.

[20]  Yoram Chisik,et al.  Ilha Musical: a CAVE for nurturing cultural appreciation , 2012, IDC '12.

[21]  Stephen Viller,et al.  Exploring virtual representations of physical artefacts in a multi-touch clothing design collaboration system , 2009, OZCHI '09.

[22]  Jacques D. Fleuriot,et al.  Diagrammatically-Driven Formal Verification of Web-Services Composition , 2012, Diagrams.

[23]  M. Jarden,et al.  Controlled rehabilitative and supportive care intervention trials in patients with high-grade gliomas and their caregivers: a systematic review , 2014, BMJ Supportive & Palliative Care.

[24]  Jörg Müller,et al.  Design and evaluation of finger-count interaction: Combining multitouch gestures and menus , 2012, Int. J. Hum. Comput. Stud..

[25]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[26]  Kevin Kok Wai Wong,et al.  Game Design Considerations When Using Non-touch Based Natural User Interface , 2011, Edutainment.