On the naturalness of touchless: Putting the “interaction” back into NUI

Norman's critique is indicative of the issue that while using the word natural might have become natural, it is coming at a cost. In other words, precisely because the notion of naturalness has become so commonplace in the scientific lexicon of HCI, so it is becoming increasingly important, it seems that there is a critical examination of the conceptual work being performed when it is used. There is a need to understand the key assumptions implicit within it and how these frame approaches to design and engineering in particular ways. A second significant element of this perspective comes from Wittgenstein, and his claim that, through action, people create shared meanings with others, and these shared meanings are the essential common ground that enable individual perception to be cohered into socially organized, understood, and coordinated experiences.

[1]  Andrea Corradini Real-Time Gesture Recognition by Means of Hybrid Recognizers , 2001, Gesture Workshop.

[2]  Claus Bossen,et al.  Mobility Work: The Spatial Dimension of Collaboration at a Hospital , 2005, Computer Supported Cooperative Work (CSCW).

[3]  Eric Harslem,et al.  The star user interface: an overview , 1899, AFIPS '82.

[4]  Susan D. Conway,et al.  Exploring the Potential , 2012 .

[5]  D. Davidson Actions, Reasons, And Causes , 1980 .

[6]  C Baur,et al.  A non-contact mouse for surgeon-computer interaction. , 2004, Technology and health care : official journal of the European Society for Engineering and Medicine.

[7]  Alan Wexelblat,et al.  An approach to natural gesture in virtual environments , 1995, TCHI.

[8]  Rashid Ansari,et al.  Multimodal human discourse: gesture and speech , 2002, TCHI.

[9]  L. Wittgenstein A certainty , 2001, BMJ : British Medical Journal.

[10]  John Bowers,et al.  Simple interfaces to complex sound in improvised music , 2000, CHI Extended Abstracts.

[11]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[12]  mc schraefel,et al.  A Taxonomy of Gestures in Human Computer Interactions , 2005 .

[13]  Brad Hartfield,et al.  Computer systems and the design of organizational interaction , 1988, TOIS.

[14]  D. Ihde Bodies in Technology , 2001 .

[15]  A. Clark,et al.  Books , 2004, INTR.

[16]  Fereydoon Vafaei,et al.  Taxonomy of Gestures in Human Computer Interaction , 2013 .

[17]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[18]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[19]  Yael Edan,et al.  Real-Time Hand Gesture Interface for Browsing Medical Images , 2008 .

[20]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[21]  Yael Edan,et al.  Optimal Consensus Intuitive Hand Gesture Vocabulary Design , 2008, 2008 IEEE International Conference on Semantic Computing.

[22]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[23]  Kjeld Schmidt,et al.  CSCW: Four Characters in Search of a Context , 1989, ECSCW.

[24]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[25]  M. Douglas Purity and Danger , 1966 .

[26]  Alexander Zelinsky,et al.  Visual gesture interfaces for virtual environments , 2002, Interact. Comput..

[27]  Kenton O'Hara,et al.  Interaction proxemics and image use in neurosurgery , 2012, CHI.

[28]  Kenton O'Hara,et al.  Exploring the potential for touchless interaction in image-guided interventional radiology , 2011, CHI.

[29]  Kenton O'Hara,et al.  Blended Interaction Spaces , 2011 .

[30]  Dan Saffer Designing gestural interfaces , 2009 .

[31]  Lucy Suchman,et al.  PROCEDURES AND PROBLEMS IN THE OFFICE , 1984 .

[32]  Paul Dourish,et al.  Where the action is , 2001 .

[33]  M. Engelmann The Philosophical Investigations , 2013 .

[34]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[35]  Sanjeev Sofat,et al.  Vision Based Hand Gesture Recognition , 2009 .

[36]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[38]  James D. Hollan,et al.  Beyond being there , 1992, CHI.

[39]  Toni Robertson,et al.  Cooperative Work and Lived Cognition: A Taxonomy of Embodied Actions , 1997, ECSCW.

[40]  Francisco J. Perales López,et al.  Toward natural interaction through visual recognition of body gestures in real-time , 2009, Interact. Comput..

[41]  J. Brown,et al.  Organizational Learning and Communities-of-Practice: Toward a Unified View of Working, Learning, and Innovation , 1991 .

[42]  Jenny Edwards,et al.  The feel dimension of technology interaction: exploring tangibles through movement and touch , 2007, TEI.

[43]  Gregory D. Abowd,et al.  Charting past, present, and future research in ubiquitous computing , 2000, TCHI.

[44]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[45]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[46]  Yvonne Rogers,et al.  Using F-formations to analyse spatial patterns of interaction in physical environments , 2011, CSCW.

[47]  Jenny Edwards,et al.  Understanding Movement as Input for Interaction-a study of Two EyeToy(tm) Games , 2004 .

[48]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[49]  Maurice Merleau-Ponty Phenomenology of Perception , 1964 .

[50]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[51]  Adam Kendon,et al.  Spacing and Orientation in Co-present Interaction , 2009, COST 2102 Training School.

[52]  E. Hall,et al.  The Hidden Dimension , 1970 .

[53]  B. Asher The Professional Vision , 1994 .

[54]  Kjeld Schmidt,et al.  Cooperative Work and Coordinative Practices - Contributions to the Conceptual Foundations of Computer-Supported Cooperative Work (CSCW) , 2011, Computer Supported Cooperative Work.

[55]  Kenton O'Hara,et al.  Understanding collective play in an urban screen game , 2008, CSCW.

[56]  Paul Dourish,et al.  Affect: from information to interaction , 2005, Critical Computing.

[57]  E. Wenger Communities of Practice: Learning, Meaning, and Identity , 1998 .

[58]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[59]  Eva Hornecker,et al.  A Design Theme for Tangible Interaction: Embodied Facilitation , 2005, ECSCW.

[60]  Cristina Masters,et al.  Bodies of Technology , 2005 .

[61]  Neville Moray,et al.  Identifying mental models of complex human–machine systems , 1998 .

[62]  Yvonne Rogers,et al.  A framework for designing sensor-based interactions to promote exploration and reflection in play , 2006, Int. J. Hum. Comput. Stud..

[63]  R. Cipolle,et al.  Computer Vision and Human-Computer Interaction , 1998 .

[64]  Mario Hernández-Tejera,et al.  Hand Gesture Recognition for Human-Machine Interaction , 2004, WSCG.

[65]  Gregory D. Abowd,et al.  Integrating status and event phenomena in formal specifications of interactive systems , 1994, SIGSOFT '94.

[66]  René de la Barré,et al.  Touchless Interaction-Novel Chances and Challenges , 2009, HCI.

[67]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[68]  Robert Moore,et al.  Purity and Danger , 2008 .

[69]  Kenton O'Hara,et al.  Blended interaction spaces for distributed team collaboration , 2011, TCHI.

[70]  Don H. Zimmerman,et al.  Ethnomethodology and the Human Sciences , 1994 .

[71]  Yael Edan,et al.  A Real-Time Hand Gesture Interface for Medical Visualization Applications , 2006 .