Design for peripheral interaction

In everyday life we perform several activities in our periphery of attention. For example, we are aware of what the weather is like and we can wash our hands without actively thinking about it. Though computing technology is becoming increasingly present in our everyday routines, interactions with these technologies usually require focused attention. Inspired by our interactions in the physical world, this thesis explores the concept of peripheral interaction: interaction with technology that takes place outside the focus of attention. We believe that this direction may support interactive devices to better blend into our everyday routines. We explore peripheral interaction by observing how everyday activities take place in the periphery and by developing and deploying a number of physical peripheral interaction designs. We conclude with a set of considerations for facilitating peripheral interaction. With this work, we hope to contribute to interaction design research and practice by providing insights in how human attention abilities can be leveraged in interaction design.

[1]  Yvonne de Kort,et al.  OPOS: an observation scheme for evaluating head-up play , 2008, NordiCHI.

[2]  Elise van den Hoven,et al.  Designing to support reasoned imagination through embodied metaphor , 2009, C&C '09.

[3]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Panos Markopoulos A Design Framework for Awareness Systems , 2009, Awareness Systems.

[5]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[6]  Stephen S. Intille,et al.  Change Blind Information Display for Ubiquitous Computing Environments , 2002, UbiComp.

[7]  Alan F. Blackwell,et al.  Peripheral tangible interaction by analytic design , 2009, Tangible and Embedded Interaction.

[8]  H. Rex Hartson,et al.  Cognitive, physical, sensory, and functional affordances in interaction design , 2003, Behav. Inf. Technol..

[9]  Koen van Boerdonk,et al.  Contact through canvas: an entertaining encounter , 2009, Personal and Ubiquitous Computing.

[10]  Elise van den Hoven,et al.  FireFlies: physical peripheral interaction design for the everyday routine of primary school teachers , 2013, TEI '13.

[11]  Pablo Llinás,et al.  Do Not Disturb: Physical Interfaces for Parallel Peripheral Interactions , 2011, INTERACT.

[12]  Anton Nijholt,et al.  Design for the periphery , 2010 .

[13]  Saskia Bakker,et al.  effMeet: peripheral interaction design for meeting management. , 2013 .

[14]  Hiroshi Ishii,et al.  Pinwheels: visualizing information flow in an architectural space , 2001, CHI Extended Abstracts.

[15]  Saskia Bakker,et al.  SpectroFlexia: interactive stained glass as a flexible peripheral information display , 2013, TEI '13.

[16]  Daniel Ashbrook Enabling mobile microinteractions , 2010 .

[17]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[18]  E. C. Cmm,et al.  on the Recognition of Speech, with , 2008 .

[19]  Elise van den Hoven,et al.  Identifying embodied metaphors in children's sound-action mappings , 2009, IDC.

[20]  Elise van den Hoven,et al.  Crossing the bridge over Norman's Gulf of Execution: revealing feedforward's true identity , 2013, CHI.

[21]  Yvonne Rogers,et al.  Interaction design gone wild: striving for wild theory , 2011, INTR.

[22]  Elizabeth D. Mynatt,et al.  Designing audio aura , 1998, CHI.

[23]  David England Whole Body Interaction: An Introduction , 2011, Whole Body Interaction.

[24]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[25]  Susan K. Lippert Social issues in the administration of information systems survey research , 2003 .

[26]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[27]  M. Uprichard The nature of research. , 1959, The Canadian nurse.

[28]  Johan Redström,et al.  Informative art: using amplified artworks as information displays , 2000, DARE '00.

[29]  Judith Good,et al.  Exploring affective technologies for the classroom with the subtle stone , 2010, CHI.

[30]  Panos Markopoulos,et al.  Evaluating player experience for children's outdoor pervasive games , 2013, Entertain. Comput..

[31]  Daniel Fallman Why Research-Oriented Design Isn’t Design-Oriented Research: On the Tensions Between Design and Research in an Implicit Design Discipline , 2007 .

[32]  Saskia Bakker,et al.  Sounds like home : sonification and physical interaction in the periphery and center of the attention , 2010 .

[33]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[34]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[35]  J. Westerink,et al.  Layered Protocols: hands-on experience , 1996, Int. J. Hum. Comput. Stud..

[36]  John Seely Brown,et al.  The coming age of calm technolgy , 1997 .

[37]  Tara Matthews,et al.  Defining, Designing, and Evaluating Peripheral Displays: An Analysis Using Activity Theory , 2007, Hum. Comput. Interact..

[38]  Elise van den Hoven,et al.  Exploring peripheral interaction design for primary school teachers , 2012, TEI.

[39]  Saskia Bakker,et al.  Interactive tangible objects as play pieces in a digital tabletop game , 2007 .

[40]  Michael Rohs,et al.  A Taxonomy of Microinteractions: Defining Microgestures Based on Ergonomic and Scenario-Dependent Requirements , 2011, INTERACT.

[41]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[42]  N. Moray Attention: selective processes in vision and hearing , 1970 .

[43]  A. Clark,et al.  Books , 2004, INTR.

[44]  Paul Dourish,et al.  Yesterday’s tomorrows: notes on ubiquitous computing’s dominant vision , 2007, Personal and Ubiquitous Computing.

[45]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[46]  Darren Edge,et al.  Tangible user interfaces for peripheral interaction , 2008 .

[47]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[48]  Stuart N. Wrigley,et al.  A Theory and Computational Model of Auditory Selective Attention , 2002 .

[49]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[50]  Elise van den Hoven,et al.  Embodied metaphors in tangible interaction design , 2011, Personal and Ubiquitous Computing.

[51]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[52]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[53]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[54]  A. Treisman VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[55]  Peter J. Denning,et al.  Beyond calculation - the next fifty years of computing , 1997 .

[56]  K. Kuutti Activity theory as a potential framework for human-computer interaction research , 1995 .

[57]  P. Treffers Tics , 1985, Clinical Neurology and Neurosurgery.

[58]  Pieter Jan Stappers,et al.  Contextmapping: experiences from practice , 2005 .

[59]  Elise van den Hoven,et al.  Grasping gestures: Gesturing with physical artifacts , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[60]  Hiroshi Ishii,et al.  Water lamp and pinwheels: ambient projection of digital information into architectural space , 1998, CHI Conference Summary.

[61]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[62]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[63]  Barry A. T. Brown,et al.  Into the wild: challenges and opportunities for field trial methods , 2011, CHI.

[64]  Elise van den Hoven,et al.  Acting by hand: Informing interaction design for the periphery of people's attention , 2012, Interact. Comput..

[65]  Helge Ritter,et al.  BROADCASTING AUDITORY WEATHER REPORTS - A PILOT PROJECT , 2003 .

[66]  Marco Kalz,et al.  Thinking outside the box a vision of ambient learning displays , 2011 .

[67]  H. Aarts,et al.  Habits as knowledge structures: automaticity in goal-directed behavior. , 2000, Journal of personality and social psychology.

[68]  C. L. M. The Psychology of Attention , 1890, Nature.

[69]  R. Hepburn,et al.  BEING AND TIME , 2010 .

[70]  Martijn H. Vastenburg,et al.  Designing to Support Social Connectedness: The Case of SnowGlobe , 2011 .

[71]  John T. Stasko,et al.  Ambient Information Systems: Evaluation in Two Paradigms , 2007, Ambient Information Systems.

[72]  Berry Eggen,et al.  Making Sense of What Is Going on 'Around': Designing Environmental Awareness Information Displays , 2009, Awareness Systems.

[73]  N. Sadat Shami,et al.  Context of Use Evaluation of Peripheral Displays (CUEPD) , 2005, INTERACT.

[74]  Paul Dourish,et al.  Where the action is , 2001 .

[75]  Hiroshi Ishii,et al.  BodyBeats: whole-body, musical interfaces for children , 2006, CHI Extended Abstracts.

[76]  M. Weiser The Computer for the Twenty-First Century , 1991 .

[77]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[78]  Chris Harrison,et al.  Whack gestures: inexact and inattentive interaction with mobile devices , 2010, TEI '10.

[79]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[80]  Elise van den Hoven,et al.  Evaluating Peripheral Interaction Design , 2015, Hum. Comput. Interact..

[81]  Chee-Kit Looi,et al.  Integrating technology in the classroom: a visual conceptualization of teachers' knowledge, goals and beliefs , 2009, J. Comput. Assist. Learn..

[82]  John N. A. Brown Expert Talk for Time Machine Session: Designing Calm Technology "as Refreshing as Taking a Walk in the Woods" , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[83]  Elise van den Hoven,et al.  Knowing by ear: leveraging human attention abilities in interaction design , 2012, Journal on Multimodal User Interfaces.

[84]  Paul Dourish,et al.  Portholes: supporting awareness in a distributed work group , 1992, CHI.

[85]  N. Moray Attention in Dichotic Listening: Affective Cues and the Influence of Instructions , 1959 .

[86]  Yvonne Rogers,et al.  Being in the thick of in-the-wild studies: the challenges and insights of researcher participation , 2012, CHI.

[87]  David V. Keyson,et al.  Considerate home notification systems: A user study of acceptability of notifications in a living-room laboratory , 2009, Int. J. Hum. Comput. Stud..

[88]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[89]  Greg Corness,et al.  Playing with the sound maker: do embodied metaphors help children learn? , 2008, IDC.

[90]  Tara Matthews,et al.  A toolkit for managing user attention in peripheral displays , 2004, UIST '04.

[91]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[92]  Elise van den Hoven,et al.  Design research & tangible interaction , 2007, TEI.

[93]  Nadya Peek,et al.  Hangsters: tangible peripheral interactive avatars for instant messaging , 2009, Tangible and Embedded Interaction.

[94]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[95]  Elise van den Hoven,et al.  Weathergods: tangible interaction in a digital tabletop game , 2007, Tangible and Embedded Interaction.

[96]  D. Kahneman,et al.  Attention and Effort , 1973 .

[97]  Sean Gustafson,et al.  PinchWatch: A Wearable Device for One-Handed Microinteractions , 2010 .

[98]  Paul Marshall,et al.  Workshop on embodied interaction: theory and practice in HCI , 2011, CHI Extended Abstracts.

[99]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[100]  S. Jones,et al.  Was There a Hawthorne Effect? , 1992, American Journal of Sociology.

[101]  Stephan Wensveen,et al.  But how, Donald, tell us how?: on the creation of meaning in interaction design through feedforward and inherent feedback , 2002, DIS '02.

[102]  Elise van den Hoven,et al.  MoSo tangibles: evaluating embodied learning , 2010, TEI.

[103]  Nelson Minar,et al.  Wearable computing meets ubiquitous computing: reaping the best of both worlds , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[104]  Elise van den Hoven,et al.  Exploring Interactive Systems Using Peripheral Sounds , 2010, HAID.

[105]  Dale Stammen,et al.  Ambient media in public spaces , 2008, SAME '08.

[106]  Jonathan Cohen,et al.  “Kirk here:”: using genre sounds to monitor background activity , 1993, INTERCHI Adjunct Proceedings.

[107]  Jh Berry Eggen,et al.  Chronoroom Clock: Peripheral Time Awareness Through Sound Localization , 2012 .

[108]  Tim Shallice,et al.  Supervisory control of action and thought selection. , 1993 .

[109]  E. Knudsen Fundamental components of attention. , 2007, Annual review of neuroscience.

[110]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[111]  David T. Neal,et al.  A new look at habits and the habit-goal interface. , 2007, Psychological review.

[112]  Pierre Dillenbourg,et al.  Distributed Awareness for Class Orchestration , 2009, EC-TEL.

[113]  Berry Eggen,et al.  Soundscapes at Workspace Zero – Design Explorations into the Use of Sound in a Shared Environment , 2008 .

[114]  Wendy Ju,et al.  The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious , 2008, Design Issues.

[115]  Frank Vetere,et al.  Visualizing use context with picture scenarios in the design process , 2005, Mobile HCI.

[116]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[117]  D. Spalding The Principles of Psychology , 1873, Nature.

[118]  Marianne Graves Petersen,et al.  Remarkable computing: the challenge of designing for the home , 2004, CHI EA '04.

[119]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[120]  Andreas Butz,et al.  StaTube: facilitating state management in instant messaging systems , 2012, Tangible and Embedded Interaction.

[121]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[122]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[123]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[124]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[125]  William W. Gaver The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[126]  K. K. Lamberty,et al.  Using a large display in the periphery to support children learning through design , 2011, IDC.

[127]  Elise van den Hoven,et al.  Tangible interaction in tabletop games: studying iconic and symbolic play pieces , 2007, ACE '07.

[128]  S. Sofaer,et al.  Qualitative Research Methods , 2011, QMiP Bulletin.

[129]  Erik Stolterman,et al.  The Nature of Design Practice and Implications for Interaction Design Research , 2008 .

[130]  Yvonne Rogers,et al.  Moving on from Weiser's Vision of Calm Computing: Engaging UbiComp Experiences , 2006, UbiComp.

[131]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[132]  Hiroshi Ishii,et al.  ambientROOM: integrating ambient media with architectural space , 1998, CHI Conference Summary.

[133]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[134]  Elizabeth D. Mynatt,et al.  Digital family portraits: supporting peace of mind for extended family members , 2001, CHI.

[135]  Elise van den Hoven,et al.  FireFlies: supporting primary school teachers through open-ended interaction design , 2012, OZCHI.

[136]  Saskia Bakker,et al.  Talking tangibles: design for peripheral interaction , 2010, Tangible and Embedded Interaction.

[137]  Kristina Höök,et al.  Comparing two approaches to context: realism and constructivism , 2005, Critical Computing.

[138]  J. Deutsch Perception and Communication , 1958, Nature.

[139]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[140]  Yelena Nakhimovsky,et al.  Mobile user experience research: challenges, methods & tools , 2009, CHI Extended Abstracts.

[141]  Joep Frens,et al.  Designing for the unknown : a design process for the future generation of highly interactive systems and products , 2008 .

[142]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[143]  Erik Stolterman,et al.  Issues in evaluating ambient displays in the wild: two case studies , 2011, CHI.

[144]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[145]  Elise van den Hoven,et al.  Framing tangible interaction frameworks , 2009, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[146]  Matt Jones,et al.  ONTRACK: Dynamically adapting music playback to support navigation , 2008, Personal and Ubiquitous Computing.

[147]  D. Lane,et al.  The Development of Selective Attention. , 1982 .

[148]  Stephan Wensveen,et al.  Interaction frogger: a design framework to couple action and function through feedback and feedforward , 2004, DIS '04.

[149]  Alain Karsenty,et al.  Unremarkable computing , 2002, CHI.

[150]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[151]  Andreas Butz,et al.  Seamless user notification in ambient soundscapes , 2005, IUI.

[152]  Scott E. Hudson,et al.  The information percolator: ambient information display in a decorative object , 1999, UIST '99.