What Is Interaction?

The term interaction is field-defining, yet surprisingly confused. This essay discusses what interaction is. We first argue that only few attempts to directly define interaction exist. Nevertheless, we extract from the literature distinct and highly developed concepts, for instance viewing interaction as dialogue, transmission, optimal behavior, embodiment, and tool use. Importantly, these concepts are associated with different scopes and ways of construing the causal relationships between the human and the computer. This affects their ability to inform empirical studies and design. Based on this discussion, we list desiderata for future work on interaction, emphasizing the need to improve scope and specificity, to better account for the effects and agency that computers have in interaction, and to generate strong propositions about interaction.

[1]  Julie A. Jacko,et al.  Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Third Edition , 2012 .

[2]  Susanne Bødker,et al.  When second wave HCI meets third wave challenges , 2006, NordiCHI '06.

[3]  Antonio Rizzo,et al.  The AVANTI project: prototyping and evaluation with a cognitive walkthrough based on the Norman's model of action , 1997, DIS '97.

[4]  John M. Flach,et al.  Control Theory for Humans: Quantitative Approaches To Modeling Performance , 2002 .

[5]  Carl Gutwin,et al.  Examining the Peak-End Effects of Subjective Experience , 2015, CHI.

[6]  J. Preece,et al.  The Human-Computer Interaction Handbook , 2003 .

[7]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[8]  Chris Baber.  Cognition and Tool Use: Forms of Engagement in Human and Animal Use of Tools , 2003 .

[9]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[10]  Alex Taylor,et al.  After interaction , 2015, Interactions.

[11]  Wayne D. Gray,et al.  Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior , 2022 .

[12]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[13]  Y. Behar,et al.  Positive Design: An Introduction to Design for Subjective Well-Being , 2014 .

[14]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[15]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[16]  Donald A. Norman,et al.  The invisible computer , 1998 .

[17]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[18]  Kjeld Schmidt,et al.  Computational Artifacts: Interactive and Collaborative Computing as an Integral Feature of Work Practice , 2016, COOP.

[19]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[20]  Vassilis Kostakos.  The big hole in HCI research , 2015, Interactions.

[21]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[22]  Glenn F. Wilson,et al.  Human-Automation Interaction Research , 2013 .

[23]  Donald A. Norman,et al.  Cognitive artifacts , 1991 .

[24]  Bonnie E. John,et al.  The Strategic Use of Complex Computer Systems , 2000, Hum. Comput. Interact..

[25]  Alex Kirlik,et al.  Adaptive Perspectives on Human-Technology Interaction: Methods and Models for Cognitive Engineering and Human-Computer Interaction (Human-Technology Interaction) , 2006 .

[26]  Erik Stolterman,et al.  The Meaning of Interactivity—Some Proposals for Definitions and Measures , 2017, Hum. Comput. Interact..

[27]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[28]  Steven M. Belz,et al.  The user action framework: a reliable foundation for usability engineering support tools , 2001, Int. J. Hum. Comput. Stud..

[29]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[30]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[31]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[32]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[33]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[34]  Susanne Bødker,et al.  Applying activity theory to video analysis: how to make sense of video data in human-computer interaction , 1995 .

[35]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[36]  Martin Ludvigsen,et al.  Aesthetic interaction: a pragmatist's aesthetics of interactive systems , 2004, DIS '04.

[37]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[38]  Grace J. Johnson,et al.  Interactivity and its Facets Revisited: Theory and Empirical Test , 2006 .

[39]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[40]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[41]  DAVID KIRSH,et al.  Interactivity and multimedia interfaces , 1997 .

[42]  Susanne Bødker,et al.  Through the Interface: A Human Activity Approach To User Interface Design , 1990 .

[43]  Andrew Howes,et al.  Adaptive Interaction: A Utility Maximization Approach to Understanding Human Interaction with Technology , 2013, Adaptive Interaction: A Utility Maximization Approach to Understanding Human Interaction with Technology.

[44]  Roderick Murray-Smith,et al.  Focused and casual interactions: allowing users to vary their level of engagement , 2013, CHI.

[45]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[46]  Michel Beaudouin-Lafon,et al.  Designing interaction, not interfaces , 2004, AVI.

[47]  Terry Winograd,et al.  What can we teach about human-computer interaction? (plenary address) , 1990, CHI '90.

[48]  Pedro Lopes,et al.  Affordance++: Allowing Objects to Communicate Dynamic Use , 2015, CHI.

[49]  M. Bunge.  Causality and modern science , 1979 .

[50]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[51]  Christopher D. Wickens,et al.  Introduction to Engineering Psychology and Human Performance , 2015 .

[52]  Shumin Zhai,et al.  Principles, Techniques and Perspectives on Optimization and HCI , 2015, CHI Extended Abstracts.

[53]  Kasper Hornbæk,et al.  Momentary Pleasure or Lasting Meaning?: Distinguishing Eudaimonic and Hedonic User Experiences , 2016, CHI.

[54]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[55]  Sascha Mahlke,et al.  Studying antecedents of emotional experiences in interactive contexts , 2007, CHI.

[56]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[57]  Ravin Balakrishnan,et al.  "Beating" Fitts' law: virtual enhancements for pointing facilitation , 2004, Int. J. Hum. Comput. Stud..

[58]  Alan Dix,et al.  Human-computer interaction, foundations and new paradigms , 2017, J. Vis. Lang. Comput..

[59]  Liam J. Bannon,et al.  Reimagining HCI: toward a more human-centered perspective , 2011, INTR.

[60]  Antonella De Angeli,et al.  Love it or hate it!: interactivity and user types , 2013, CHI.

[61]  D. Shepherd,et al.  Theory Building , 2017 .

[62]  Paul Dourish,et al.  Where the action is , 2001 .

[63]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.

[64]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[65]  Robert J. B. Hutton.  Book review of The Invisible Computer: Why Good Products Fail, the Personal Computer Is So Complex, and Information Appliances Are the Solution , 2000 .

[66]  Yvonne Rogers,et al.  Reflecting human values in the digital age , 2009, CACM.

[67]  Kasper Hornbæk,et al.  Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience , 2011, CHI.

[68]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[69]  Michael Rohs,et al.  Follow the Force: Steering the Index Finger towards Targets using EMS , 2016, CHI Extended Abstracts.

[70]  Antti Oulasvirta,et al.  HCI Research as Problem-Solving , 2016, CHI.

[71]  Stephen J. Payne,et al.  Looking HCI in the I , 1990, INTERACT.

[72]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[73]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[74]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[75]  Yvonne Rogers,et al.  Introduction to the Special Issue of “The Turn to The Wild” , 2013, TCHI.

[76]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[77]  John M. Carroll,et al.  Human-computer interaction: psychology as a science of design , 1997, Int. J. Hum. Comput. Stud..

[78]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[79]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[80]  K. Kuutti.  Activity theory as a potential framework for human-computer interaction research , 1995 .

[81]  Matthew Chalmers,et al.  Seamful interweaving: heterogeneity in the theory and design of interactive systems , 2004, DIS '04.

[82]  R. Pea.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1987 .

[83]  Steven C. Seow.  Information Theoretic Models of HCI: A Comparison of the Hick-Hyman Law and Fitts' Law , 2005, Hum. Comput. Interact..

[84]  Liam J. Bannon,et al.  The turn to practice in HCI: towards a research agenda , 2014, CHI.

[85]  Jesse Hoey,et al.  Bayesian Affect Control Theory , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[86]  J I Elkind,et al.  Human Factors and the Design of Time Sharing Computer Systems1 , 1968, Human factors.

[87]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[88]  Dan Saffer,et al.  Designing for Interaction: Creating Innovative Applications and Devices , 2009 .

[89]  John R. Anderson.  ACT: A simple theory of complex cognition. , 1996 .

[90]  Pertti Saariluoma.  Editor's instruction : The challenges and opportunities of Human Technology , 2005 .

[91]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[92]  Sarah Diefenbach,et al.  Needs, affect, and interactive products - Facets of user experience , 2010, Interact. Comput..

[93]  Wai-Tat Fu,et al.  Ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head , 2001, CHI.

[94]  John Kammersgaard.  Four Different Perspectives on Human-Computer Interaction , 1988, Int. J. Man Mach. Stud..

[95]  Yvonne Rogers,et al.  HCI Theory: Classical, Modern, and Contemporary , 2012, HCI Theory.