Reflexive Interaction: Extending the concept of Peripheral Interaction

Human-computer interaction (HCI) continues to evolve and interaction scenarios have to fulfill mobility, flexibility, and ad-hoc interaction where ever users are. To address this, traditional interaction concepts are being extended. While Peripheral Interaction was previously introduced, it still remains as a rather broad concept, intersecting with others, and thus creating space for further definitions. Therefore, this paper introduces the concept of Reflexive Interaction, which can be viewed as a specific manifestation of Peripheral Interaction. In contrast, Reflexive Interaction is envisioned to be executed at a secondary task without involving substantial cognitive effort. It allows the user to perform very short interactions, shorter than Microinteractions, without straining the user's main interaction channels occupied with the primary task. To clearly classify Reflexive Interaction in respect to previous interaction concepts, we use a taxonomy relying on an attention-based HCI model.

[1]  Jo Vermeulen,et al.  Fluent transitions between focused and peripheral interaction in proxemic interactions , 2016 .

[2]  R. Pea User Centered System Design: New Perspectives on Human-Computer Interaction , 2021 .

[3]  Doris Hausen,et al.  Peripheral interaction: facilitating interaction with secondary tasks , 2012, TEI.

[4]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[5]  D. Norman Toward a theory of memory and attention. , 1968 .

[6]  Alan F. Blackwell,et al.  Peripheral tangible interaction by analytic design , 2009, Tangible and Embedded Interaction.

[7]  Lynette A. Jones,et al.  Evaluating Vibrotactile Dimensions for the Design of Tactons , 2014, IEEE Transactions on Haptics.

[8]  Elise van den Hoven,et al.  FireFlies: physical peripheral interaction design for the everyday routine of primary school teachers , 2013, TEI '13.

[9]  Anton Nijholt,et al.  Design for the periphery , 2010 .

[10]  Hideki Koike,et al.  Opisthenar: Hand Poses and Finger Tapping Recognition by Observing Back of Hand Using Embedded Wrist Camera , 2019, UIST.

[11]  Roderick Murray-Smith,et al.  Focused and casual interactions: allowing users to vary their level of engagement , 2013, CHI.

[12]  BeamBand , 2019, Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.

[13]  Marian Haescher,et al.  Properties of a Peripheral Head-Mounted Display (PHMD) , 2015, HCI.

[14]  Daniel Ashbrook Enabling mobile microinteractions , 2010 .

[15]  Marian Haescher,et al.  SeismoTracker: Upgrade any Smart Wearable to enable a Sensing of Heart Rate, Respiration Rate, and Microvibrations , 2016, CHI Extended Abstracts.

[16]  Arjan Kuijper,et al.  CapSoles: who is walking on what kind of floor? , 2017, MobileHCI.

[17]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[18]  Henning Pohl Casual Interaction : Scaling Fidelity for Low-Engagement Interactions , 2014 .

[19]  Denys J. C. Matthies InEar BioFeedController: a headset for hands-free and eyes-free interaction with mobile devices , 2013, CHI Extended Abstracts.

[20]  Yang Cao,et al.  Ringteraction: Coordinated Thumb-index Interaction Using a Ring , 2016, CHI Extended Abstracts.

[21]  Suranga Nanayakkara,et al.  ChewIt. An Intraoral Interface for Discreet Interactions , 2019, CHI.

[22]  Daniel Vogel,et al.  Tip-Tap: Battery-free Discrete 2D Fingertip Input , 2019, UIST.

[23]  C. Wickens,et al.  Applied Attention Theory , 2007 .

[24]  John Seely Brown,et al.  The coming age of calm technolgy , 1997 .

[25]  Ted Selker,et al.  Designing for Peripheral Interaction: seamlessly integrating interactive technology in everyday life , 2015, Interaction Design and Architecture(s).

[26]  Elise van den Hoven,et al.  Exploring peripheral interaction design for primary school teachers , 2012, TEI.

[27]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[28]  Phoebe Sengers,et al.  The Three Paradigms of HCI , 2007 .

[29]  Sebastian Boring,et al.  The Unadorned Desk: Exploiting the Physical Space around a Display as an Input Canvas , 2013, INTERACT.

[30]  P. Hartvigsen The Computer for the 21st Century (1991) , 2014 .

[31]  Robert W. Proctor,et al.  Handbook of Human Factors in Web Design , 2009 .

[32]  Saskia Bakker Design for peripheral interaction , 2013 .

[33]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[34]  Shengdong Zhao,et al.  Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin , 2015, MobileHCI.

[35]  Rafael Ramírez,et al.  Detecting Emotion from EEG Signals Using the Emotive Epoc Device , 2012, Brain Informatics.

[36]  Obert,et al.  Association between Cellular-Telephone Calls and Motor Vehicle Collisions , 2000 .

[37]  Nicolai Marquardt,et al.  Proxemic interactions in ubiquitous computing ecologies , 2011, CHI Extended Abstracts.

[38]  Kristof Van Laerhoven,et al.  A typology of wearable activity recognition and interaction , 2015, iWOAR.

[39]  A. Scherzer,et al.  Primitive Reflex Profile , 1985, Developmental medicine and child neurology.

[40]  Marian Haescher,et al.  aHead: Considering the Head Position in a Multi-sensory Setup of Wearables to Recognize Everyday Activities with Intelligent Sensor Fusions , 2015, HCI.

[41]  Shengdong Zhao,et al.  Positioning Glass: Investigating Display Positions of Monocular Optical See-Through Head-Mounted Display , 2016, ChineseCHI2016.

[42]  A. Dornhorst,et al.  The reinforcement of tendon-reflexes. , 1957, Lancet.

[43]  Kim Halskov,et al.  Taking action on distraction , 2016, Interactions.

[44]  James H. Carlisle Evaluating the impact of office automation on top management communication , 1976, AFIPS '76.

[45]  Chris Harrison,et al.  The human body as an interactive computing platform , 2013 .

[46]  Mike Reynolds,et al.  The development of a theoretical framework and design tool for process usability assessment , 2003, Ergonomics.

[47]  Ted Selker,et al.  Peripheral Interaction , 2016, Human–Computer Interaction Series.

[48]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[49]  C. Sherrington,et al.  Reflexes in Response to Stretch (Myotatic Reflexes) , 1924 .

[50]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[51]  N. Moray Attention in Dichotic Listening: Affective Cues and the Influence of Instructions , 1959 .

[52]  Niels Taatgen,et al.  Toward a unified theory of the multitasking continuum: from concurrent performance to task switching, interruption, and resumption , 2009, CHI.

[53]  D. Zafeiriou Primitive reflexes and postural reactions in the neurodevelopmental examination. , 2004, Pediatric neurology.

[54]  D. Strayer,et al.  Multi-Tasking in the Automobile , 2005 .

[55]  Michael Jones,et al.  A Sip-and-Puff Wireless Remote Control for the Apple iPod , 2008, Assistive technology : the official journal of RESNA.

[56]  M. Posner,et al.  Components of visual orienting , 1984 .

[57]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[58]  Pattie Maes,et al.  eye-q: eyeglass peripheral display for subtle intimate notifications , 2006, Mobile HCI.

[59]  J F Juola,et al.  Control of attention around the fovea. , 1991, Journal of experimental psychology. Human perception and performance.

[60]  Andreas Butz,et al.  Peripheral interaction: shaping the research and design space , 2014, CHI Extended Abstracts.

[61]  Daniel Vogel,et al.  Tap-Kick-Click: Foot Interaction for a Standing Desk , 2016, Conference on Designing Interactive Systems.

[62]  Bodo Urban,et al.  EarFieldSensing: A Novel In-Ear Electric Field Sensing to Enrich Wearable Gesture Input through Facial Expressions , 2017, CHI.

[63]  Takeo Igarashi,et al.  Exploring Subtle Foot Plantar-based Gestures with Sock-placed Pressure Sensors , 2015, CHI.

[64]  J. H. Eggen,et al.  Peripheral interaction : embedding HCI in everyday life , 2013 .

[65]  Mark Weiser The computer for the 21st century , 1991 .

[66]  Martin Weigel Interactive on-skin devices for expressive touch-based interactions , 2017 .

[67]  Erik Hollnagel,et al.  Joint Cognitive Systems: Patterns in Cognitive Systems Engineering , 2006 .

[68]  E. M. Altmann,et al.  Momentary interruptions can derail the train of thought. , 2014, Journal of experimental psychology. General.

[69]  Tsutomu Terada,et al.  A Lifelog System for Detecting Psychological Stress with Glass-equipped Temperature Sensors , 2016, AH.

[70]  John N. A. Brown “Unseen, Yet Crescive”: The Unrecognized History of Peripheral Interaction , 2016 .

[71]  Katrin Wolf,et al.  Microgestures—Enabling Gesture Input with Busy Hands , 2016 .

[72]  Wendy Ju,et al.  The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious , 2008, Design Issues.

[73]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[74]  Chris Harrison,et al.  BeamBand: Hand Gesture Sensing with Ultrasonic Beamforming , 2019, CHI.

[75]  B. Skinner What is the experimental analysis of behavior? , 1966, Journal of the experimental analysis of behavior.

[76]  Suranga Nanayakkara,et al.  GymSoles: Improving Squats and Dead-Lifts by Visualizing the User's Center of Pressure , 2019, CHI.

[77]  Suranga Nanayakkara,et al.  Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity , 2018, SUI.

[78]  Bodo Urban,et al.  Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation , 2015, iWOAR.

[79]  Doris Hausen Peripheral interaction: exploring the design space , 2014 .

[80]  Buntarou Shizuki,et al.  CanalSense: Face-Related Movement Recognition System based on Sensing Air Pressure in Ear Canals , 2017, UIST.

[81]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[82]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[83]  A. Dickinson Conditioning and associative learning. , 1981, British medical bulletin.

[84]  B. Skinner,et al.  An operant analysis of problem solving , 1984, Behavioral and Brain Sciences.

[85]  Edwin Hutchins,et al.  Metaphors for Interface Design , 1987 .

[86]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[87]  Pedro Lopes,et al.  Muscle-propelled force feedback: bringing force feedback to mobile devices , 2013, CHI.

[88]  Suranga Nanayakkara,et al.  2bit-TactileHand: Evaluating Tactons for On-Body Vibrotactile Displays on the Hand and Wrist , 2019, AH.

[89]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[90]  Joseph A. Paradiso,et al.  WristFlex: low-power gesture input with wrist-worn pressure sensors , 2014, UIST.

[91]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[92]  Gregory D. Abowd,et al.  FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing , 2018, CHI.

[93]  J. Juola Theories of Focal and Peripheral Attention , 2016 .

[94]  Patrick Baudisch,et al.  Skin Drag Displays: Dragging a Physical Tactor across the User's Skin Produces a Stronger Tactile Stimulus than Vibrotactile , 2015, CHI.

[95]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[96]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[97]  Bodo Urban,et al.  Scaling Notifications Beyond Alerts: From Subtly Drawing Attention up to Forcing the User to Take Action , 2018, UIST.

[98]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[99]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[100]  D. Norman,et al.  Psychological Issues in Support of Multiple Activities , 1986 .

[101]  R. Tibshirani,et al.  Association between cellular-telephone calls and motor vehicle collisions. , 1997, The New England journal of medicine.

[102]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[103]  Víctor M. González,et al.  Why do i keep interrupting myself?: environment, habit and self-interruption , 2011, CHI.

[104]  Frank A. Drews,et al.  Multi-Tasking in the Automobile , 2005 .

[105]  D. Strayer,et al.  Cell phone-induced failures of visual attention during simulated driving. , 2003, Journal of experimental psychology. Applied.

[106]  David J. Gill Principles and Practice of Behavioral Neurology and Neuropsychology , 2005, Neurology.

[107]  Kimiko Ryokai,et al.  Tensions of Data-Driven Reflection: A Case Study of Real-Time Emotional Biosensing , 2018, CHI.

[108]  A. Capute,et al.  Primitive reflex profile , 1978 .

[109]  H. C. Warren A classification of reflexes, instincts, and emotional phenomena. , 1919 .

[110]  Anne Treisman,et al.  Monitoring and storage of irrelevant messages in selective attention , 1964 .

[111]  D. Broadbent Perception and communication , 1958 .

[112]  Opisthenar , 2019, Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology.