HCI Theory: Classical, Modern, and Contemporary

Theory is the bedrock of many sciences, providing a rigorous method to advance knowledge, through testing and falsifying hypotheses about observable phenomena. To begin with, the nascent field of HCI followed the scientific method borrowing theories from cognitive science to test theories about user performance at the interface. But HCI has emerged as an eclectic interdiscipline rather than a well-defined science. It now covers all aspects of human life, from birth to bereavement, through all manner of computing, from device ecologies to nano-technology. It comes as no surprise that the role of theory in HCI has also greatly expanded from the early days of scientific testing to include other functions such as describing, explaining, critiquing, and as the basis for generating new designs. The book charts the theoretical developments in HCI, both past and present, reflecting on how they have shaped the field. It explores both the rhetoric and the reality: how theories have been conceptualized, what was promised, how they have been used and which has made the most impact in the field -- and the reasons for this. Finally, it looks to the future and asks whether theory will continue to have a role, and, if so, what this might be.

[1]  Christian Heath,et al.  Collaborative Activity and Technological Design: Task Coordination in London Underground Control Rooms , 1991, ECSCW.

[2]  Ian Taylor,et al.  Designing novel interactional workspaces to support face to face consultations , 2003, CHI '03.

[3]  Terry Winograd,et al.  Categories, disciplines, and social coordination , 1997, Computer Supported Cooperative Work (CSCW).

[4]  Gilbert Cockton Design situations and methodological innovation in interaction design , 2010, CHI EA '10.

[5]  Dan Shapiro,et al.  The limits of ethnography: combining social sciences for CSCW , 1994, CSCW '94.

[6]  Elihu M. Gerson,et al.  Analyzing due process in the workplace , 1986, COCS '86.

[7]  Yoshinori Kobayashi,et al.  Revealing Gauguin: engaging visitors in robot guide's explanation in an art museum , 2009, CHI.

[8]  Greg Corness,et al.  Human-computer-intuition? Exploring the cognitive basis for intuition in embodied interaction , 2009, Int. J. Arts Technol..

[9]  Yvonne Rogers,et al.  Let's Work Together: Supporting Two-Party Collaborations with New Forms of Shared Interactive Representations , 2002, COOP.

[10]  Eli Blevis,et al.  Sustainable interaction design: invention & disposal, renewal & reuse , 2007, CHI.

[11]  Gregg C. Vanderheiden,et al.  Ubiquitous Accessibility, Common Technology Core, and Micro Assistive Technology: Commentary on “Computers and People with Disabilities” , 2008, TACC.

[12]  Yvonne Rogers,et al.  Taking the 'No' out of Lotus Notes: activity theory, groupware, and student groupwork , 2002, CSCL.

[13]  Yvonne Rogers,et al.  Interaction design gone wild: striving for wild theory , 2011, INTR.

[14]  B. Latour Reassembling the Social: An Introduction to Actor-Network-Theory , 2005 .

[15]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[16]  Donald A. Norman,et al.  Cognition in the Head and in the World: An Introduction to the Special Issue on Situated Action , 1993, Cogn. Sci..

[17]  Lucy A. Suchman,et al.  Office procedure as practical action: models of work and system design , 1983, TOIS.

[18]  Ann Blandford,et al.  Understanding emergency medical dispatch in terms of distributed cognition: a case study , 2006, Ergonomics.

[19]  Austin Henderson,et al.  Conceptual Models: Core to Good Design , 2011, Conceptual Models.

[20]  Paul Dourish,et al.  Responsibilities and implications: further thoughts on ethnography and design , 2007, DUX '07.

[21]  Paul Dourish,et al.  Implications for design , 2006, CHI.

[22]  J. O. Urmson,et al.  How to Do Things with Words@@@The William James Lectures , 1963 .

[23]  David A. Duce,et al.  Systems, interactions, and macrotheory , 2000, TCHI.

[24]  S. Engel Thought and Language , 1964 .

[25]  Yvonne Rogers,et al.  The Changing Face of Human-Computer Interaction in the Age of Ubiquitous Computing , 2009, USAB.

[26]  Jeff A. Johnson,et al.  User preferences for task-specific vs. generic application software , 1994, CHI '94.

[27]  Stephen W. Draper Book Review: Activity Theory: The New Direction for HCI? "Designing Interaction: Psychology at the Human-Computer Interface," edited by J. M. Carroll , 1992, Int. J. Man Mach. Stud..

[28]  W. Keith Edwards,et al.  Intelligibility and Accountability: Human Considerations in Context-Aware Systems , 2001, Hum. Comput. Interact..

[29]  Shaowen Bardzell,et al.  Interaction criticism: a proposal and framework for a new discipline of hci , 2008, CHI Extended Abstracts.

[30]  DAVID KIRSH,et al.  Interactivity and multimedia interfaces , 1997 .

[31]  Peter C. Wright,et al.  Designing culturally situated technologies for the home , 2003, CHI Extended Abstracts.

[32]  William W. Gaver Technology affordances , 1991, CHI.

[33]  Steve Benford,et al.  Ambiguity as a resource for design , 2003, CHI '03.

[34]  Jonathan Grudin,et al.  The computer reaches out: the historical continuity of interface design , 1989, CHI '90.

[35]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[36]  Daniel J. Burns,et al.  TEXT EDITING PERFORMANCE AS A FUNCTION OF TRAINING WITH COMMAND TERMS OF DIFFERING LENGTHS AND FREQUENCIES , 1986, SGCH.

[37]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..

[38]  Gilbert Cockton,et al.  Designing worth is worth designing , 2006, NordiCHI '06.

[39]  Yvonne Rogers,et al.  New theoretical approaches for human-computer interaction , 2005, Annu. Rev. Inf. Sci. Technol..

[40]  Victor Kaptelinin,et al.  Activity Theory: Basic Concepts and Applications , 1995, EWHCI.

[41]  Shaowen Bardzell,et al.  Critical issues in interaction design , 2008 .

[42]  Robert E. Kraut,et al.  Does CSCW need organization theory? , 2004, CSCW.

[43]  Paul Dourish,et al.  Technomethodology: paradoxes and possibilities , 1996, CHI.

[44]  T. Winograd,et al.  From Computing Machinery to Interaction Design , 2004 .

[45]  Bonnie E. John,et al.  CPM-GOMS: an analysis method for tasks with parallel activities , 1995, CHI '95.

[46]  B. Nardi Context and consciousness: activity theory and human-computer interaction , 1995 .

[47]  Robert J. Anderson,et al.  Representations and Requirements: The Value of Ethnography in System Design , 1994, Hum. Comput. Interact..

[48]  Paul Dourish,et al.  Yesterday’s tomorrows: notes on ubiquitous computing’s dominant vision , 2007, Personal and Ubiquitous Computing.

[49]  CHRISTINE A. HALVERSON,et al.  Activity Theory and Distributed Cognition: Or What Does CSCW Need to DO with Theories? , 2002, Computer Supported Cooperative Work (CSCW).

[50]  Paul Dourish,et al.  Reflective HCI: towards a critical technical practice , 2004, CHI EA '04.

[51]  Alan F. Blackwell,et al.  Correlates of the cognitive dimensions for tangible user interface , 2006, J. Vis. Lang. Comput..

[52]  Johan Redström,et al.  From use to presence: on the expressions and aesthetics of everyday computational things , 2002, TCHI.

[53]  C. Geertz The interpretation of cultures: Selected essays , 1975 .

[54]  Julie A. Jacko,et al.  Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Third Edition , 2012 .

[55]  David Kirsh,et al.  The Context of Work , 2001, Hum. Comput. Interact..

[56]  Henrik Artman,et al.  Distributed Cognition in an Emergency Co-ordination Center , 1999, Cognition, Technology & Work.

[57]  Ann Blandford,et al.  Confessions from a grounded theory PhD: experiences and lessons learnt , 2011, CHI.

[58]  ALISTAIR SUTCLIFFE,et al.  On the effective use and reuse of HCI knowledge , 2000, TCHI.

[59]  Jonathan Grudin,et al.  Living without parental controls: the future of HCI , 2007, INTR.

[60]  Wiebe E. Bijker,et al.  Of Bicycles, Bakelites, and Bulbs: Toward a Theory of Sociotechnical Change , 1995 .

[61]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[62]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[63]  Graham Button Cognition in the Wild, Edwin Hutchins , 2004, Computer Supported Cooperative Work (CSCW).

[64]  K. J. Vicente,et al.  The Ecology of Human-Machine Systems II: Mediating 'Direct Perception' in Complex Work Domains , 1990 .

[65]  L. Suchman Plans and situated actions , 1987 .

[66]  Kipling D. Williams,et al.  Interpersonal Relations and Group Processes Social Loafing: a Meta-analytic Review and Theoretical Integration , 2022 .

[67]  Terry Winograd,et al.  Bringing Design to Software , 1996 .

[68]  Steve Benford,et al.  From interaction to trajectories: designing coherent journeys through user experiences , 2009, CHI.

[69]  Yvonne Rogers,et al.  Equal Opportunities: Do Shareable Interfaces Promote More Group Participation Than Single User Displays? , 2009, Hum. Comput. Interact..

[70]  Victor Kaptelinin,et al.  Methods & tools: The activity checklist: a tool for representing the “space” of context , 1999, INTR.

[71]  Kevin Crowston,et al.  What is coordination theory and how can it help design cooperative work systems? , 1990, CSCW '90.

[72]  Wendy E. Mackay,et al.  Video artifacts for design: bridging the Gap between abstraction and detail , 2000, DIS '00.

[73]  Ray Monk,et al.  Fundamentals of Human-Computer Interaction , 1984 .

[74]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[75]  Eva Hornecker,et al.  What do lab-based user studies tell us about in-the-wild behavior?: insights from a study of museum interactives , 2012, DIS '12.

[76]  John M. Carroll,et al.  Introduction: Toward a Multidisciplinary Science of Human-Computer Interaction , 2003 .

[77]  Austin Henderson,et al.  Making sense of sensing systems: five questions for designers and researchers , 2002, CHI.

[78]  Bonnie A. Nardi,et al.  Coda and Response to Christine Halverson , 2002, Computer Supported Cooperative Work (CSCW).

[79]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[80]  Liam J. Bannon,et al.  Reimagining HCI: toward a more human-centered perspective , 2011, INTR.

[81]  Yvonne Rogers,et al.  Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface , 2011, CHI.

[82]  Yvonne Rogers,et al.  Using F-formations to analyse spatial patterns of interaction in physical environments , 2011, CSCW.

[83]  Christine Halverson,et al.  Considering an organization's memory , 1998, CSCW '98.

[84]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[85]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[86]  Helen Sharp,et al.  Collaboration and co-ordination in mature eXtreme programming teams , 2008, Int. J. Hum. Comput. Stud..

[87]  E. Hutchins,et al.  Constructing Meaning from Space, Gesture, and Speech , 1997 .

[88]  Yvonne Rogers,et al.  Entry and access : how shareability comes about , 2007 .

[89]  Jonathan Grudin Turing maturing: the separation of artificial intelligence and human-computer interaction , 2006, INTR.

[90]  Tom Carey,et al.  Human-computer interaction , 1994 .

[91]  Marc Hassenzahl,et al.  The Effect of Perceived Hedonic Quality on Product Appealingness , 2001, Int. J. Hum. Comput. Interact..

[92]  Robert E. Kraut,et al.  CHAPTER 12 – Applying Social Psychological Theory to the Problems of Group Work , 2002 .

[93]  Yvonne Rogers,et al.  What Are Workplace Studies For? , 1995, ECSCW.

[94]  Yvonne Rogers,et al.  Ubi-learning integrates indoor and outdoor experiences , 2005, CACM.

[95]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[96]  William Lidwell,et al.  Universal Principles of Design , 2003 .

[97]  Yvonne Rogers,et al.  Models in the mind : theory, perspective and application , 1992 .

[98]  Ann Blandford,et al.  DiCoT: A Methodology for Applying Distributed Cognition to the Design of Teamworking Systems , 2005, DSV-IS.

[99]  Jeffrey Bardzell,et al.  Interaction criticism and aesthetics , 2009, CHI.

[100]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[101]  Sunny Consolvo,et al.  Development of a Privacy Addendum for Open Source Licenses: Value Sensitive Design in Industry , 2006, UbiComp.

[102]  Yvonne Rogers,et al.  A framework for designing sensor-based interactions to promote exploration and reflection in play , 2006, Int. J. Hum. Comput. Stud..

[103]  Susanne Bødker,et al.  When second wave HCI meets third wave challenges , 2006, NordiCHI '06.

[104]  Mark Weiser The computer for the 21st century , 1991 .

[105]  Christine Satchell,et al.  Cultural theory and real world design: Dystopian and Utopian Outcomes , 2008, CHI.

[106]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[107]  William B. Rouse,et al.  Human Detection and Diagnosis of System Failures , 1981 .

[108]  Mark A. Spasser Realist Activity Theory for Digital Library Evaluation: Conceptual Framework and Case Study , 2002, Computer Supported Cooperative Work (CSCW).

[109]  Paul Dourish,et al.  Security in the wild: user strategies for managing security as an everyday, practical problem , 2004, Personal and Ubiquitous Computing.

[110]  Andrew Singer,et al.  Directions in Human Factors for Interactive Systems , 1981, Lecture Notes in Computer Science.

[111]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[112]  Felipe Castel Theory, theory on the wall , 2002, CACM.

[113]  Tom Rodden,et al.  Ethnography considered harmful , 2009, CHI.

[114]  John Karat Taking software design seriously : practical techniques for human-computer interaction design , 1991 .

[115]  Gillian R. Hayes The relationship of action research to human-computer interaction , 2011, TCHI.

[116]  Yvonne Rogers,et al.  Let's get physical: The learning benefits of interacting in digitally augmented physical spaces , 2004, Comput. Educ..

[117]  Yvonne Rogers,et al.  Mechanisms for collaboration: A design and evaluation framework for multi-user interfaces , 2012, TCHI.

[118]  Ben Shneiderman,et al.  The Craft of Information Visualization: Readings and Reflections , 2003 .

[119]  Yvonne Rogers,et al.  Coordinating computer-mediated work , 1992, Computer Supported Cooperative Work (CSCW).

[120]  Jörn Hurtienne,et al.  Cognition in HCI: An Ongoing Story , 2009 .

[121]  Shaowen Bardzell,et al.  Pleasure is your birthright: digitally enabled designer sex toys as a case of third-wave HCI , 2011, CHI.

[122]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[123]  A. N. Leont’ev The Problem of Activity in the History of Soviet Psychology , 1989 .

[124]  Clara Mancini,et al.  Animal-computer interaction: a manifesto , 2011, INTR.

[125]  R. Hepburn,et al.  BEING AND TIME , 2010 .

[126]  Giuseppe Mantovani,et al.  Social Context in HCI: A New Framework for Mental Models, Cooperation, and Communication , 1996, Cogn. Sci..

[127]  Nick Hammond,et al.  Learning and remembering interactive commands in a text-editing task , 1982 .

[128]  Rebecca E. Grinter Decomposition : ABSTRACT Putting It All Back , 2022 .

[129]  Yvonne Rogers,et al.  Why It's Worth the Hassle: The Value of In-Situ Studies When Designing Ubicomp , 2007, UbiComp.

[130]  Yvonne Rogers,et al.  Young Children's Spatial Representations Developed through Exploration of a Desktop Virtual Reality Scene , 2000, Education and Information Technologies.

[131]  Suprateek Sarker,et al.  Using an adapted grounded theory approach for inductive theory building about virtual team development , 2000, DATB.

[132]  J. McGrath Time, Interaction, and Performance (TIP) , 1991 .

[133]  Tom Rodden,et al.  Designing with ethnography: a presentation framework for design , 1997, DIS '97.

[134]  Y. Rogers,et al.  Interaction Design , 2002 .

[135]  Sara A. Bly,et al.  Field work: is it product work? , 1997, INTR.

[136]  David F. Redmiles,et al.  Activity Theory and System Design: A View from the Trenches , 2002, Computer Supported Cooperative Work (CSCW).

[137]  Kjeld Schmidt,et al.  Cooperative Work and Coordinative Practices - Contributions to the Conceptual Foundations of Computer-Supported Cooperative Work (CSCW) , 2011, Computer Supported Cooperative Work.

[138]  Ann Blandford,et al.  DiCoT Modeling: From Analysis to Design , 2010 .

[139]  Yvonne Rogers,et al.  A framework for designing interactive multimedia to scaffold young children's understanding of historical chronology , 2002 .

[140]  Albrecht Schmidt,et al.  The drift table: designing for ludic engagement , 2004, CHI EA '04.

[141]  John M. Carroll,et al.  Designing Interaction: Psychology at the Human-Computer Interface , 1991 .

[142]  Susanne Bødker A Human Activity Approach to User Interfaces , 1989, Hum. Comput. Interact..

[143]  Paul Dourish,et al.  Where the action is , 2001 .

[144]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[145]  David J. Gilmore,et al.  Delivering Cognitive Psychology to HCI: The Problems of Common Language and of Knowledge Transfer , 1996, Interact. Comput..

[146]  Yvonne Rogers,et al.  Exploring obstacles: integrating CSCW in evolving organisations , 1994, CSCW '94.

[147]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[148]  Phoebe Sengers,et al.  Staying open to interpretation: engaging multiple meanings in design and evaluation , 2006, DIS '06.

[149]  Eli Blevis,et al.  FEATURETranscending disciplinary boundaries in interaction design , 2009, Interactions.

[150]  William J. Clancey,et al.  Situated Action: A Neuropsychologiwl Interpretation Response to Vera and Simon , 2005 .

[151]  Richard Bentley,et al.  Ethnographically-informed systems design for air traffic control , 1992, CSCW '92.

[152]  Jonas Löwgren,et al.  Interaction criticism: three readings of an interaction design, and what they get us , 2010, INTR.

[153]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[154]  R. Jacob Human-computer interaction: input devices , 1996, CSUR.

[155]  Dominique L. Scapin,et al.  Computer Commands in Restricted Natural Language: Some Aspects of Memory and Experience , 1981 .

[156]  Edward T. Hall,et al.  A System for the Notation of Proxemic Behavior1 , 1963 .

[157]  Bonnie E. John,et al.  Cogtool-explorer: towards a tool for predicting user interaction , 2008, CHI Extended Abstracts.

[158]  Yvonne Rogers 57 Varieties of Activity Theory , 2008, Interact. Comput..

[159]  Daniel Fallman,et al.  The new good: exploring the potential of philosophy of technology to contribute to human-computer interaction , 2011, CHI.

[160]  Yvonne Rogers,et al.  Nudging the Trolley in the Supermarket: How to Deliver the Right Information to Shoppers , 2011, Int. J. Mob. Hum. Comput. Interact..

[161]  Ben Shneiderman,et al.  Claiming success, charting the future: micro-HCI and macro-HCI , 2011, INTR.

[162]  Steve Harrison,et al.  Making epistemological trouble: Third-paradigm HCI as successor science , 2011, Interact. Comput..

[163]  Bob Fields,et al.  ANALYSING HUMAN-COMPUTER INTERACTION AS DISTRIBUTED COGNITION: THE RESOURCES MODEL , 1999 .

[164]  Robert St. Amant,et al.  User Interface Affordances in a Planning Representation , 1999, Hum. Comput. Interact..

[165]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[166]  Liam J. Bannon Re-framing HCI: from human-computer interaction to human-centred interaction design , 2011, CHItaly.