Physio-Stacks: Supporting Communication with Ourselves and Others via Tangible, Modular Physiological Devices

Our physiological activity reflects our inner workings. However, we are not always aware of it in full detail. Physiological devices allow us to monitor and create adaptive systems and support introspection. Given that these devices have access to sensitive data, it is vital that users have a clear understanding of the internal mechanisms (extrospection), yet the underlying processes are hard to understand and control, resulting in a loss of agency. In this work, we focus on bringing the agency back to the user, by using design guidelines based on principles of honest communication and driven by positive activities. To this end, we conceived a tangible, modular approach for the construction of physiological interfaces that can be used as a prototyping toolkit by designers and researchers, or as didactic tools by educators and pupils. We show the potential of such an approach with a set of examples, supporting introspection, dialog, music creation, and play.

[1]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[2]  Yu-Chun Huang,et al.  Heartbeat Jenga: A Biofeedback Board Game to Improve Coordination and Emotional Control , 2015, HCI.

[3]  Hiroshi Ishii,et al.  ambienBeat: Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic Regulation , 2020, Tangible and Embedded Interaction.

[4]  Bret Victor,et al.  Humane representation of thought: a trail map for the 21st century , 2014, UIST.

[5]  Ana Cristina Vasconcelos,et al.  ‘The presentation of self in the online world’: Goffman and the study of online identities , 2013, J. Inf. Sci..

[6]  Elisabeth André,et al.  TangibleHeart - Enabling Critical and Shared Reflections of Heart Behaviours , 2017, BCS HCI.

[7]  Robert Phillips,et al.  "Proof in the Pudding": Designing IoT Plants to Promote Wellbeing , 2017, Conference on Designing Interactive Systems.

[8]  Melanie Swan,et al.  The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery , 2013, Big Data.

[9]  Sergi Jordà,et al.  Physiopucks: Increasing User Motivation by Combining Tangible and Implicit Physiological Interaction , 2016, ACM Trans. Comput. Hum. Interact..

[10]  Mirjana Prpa,et al.  Attending to Breath: Exploring How the Cues in a Virtual Environment Guide the Attention to Breath and Shape the Quality of Experience to Support Mindfulness , 2018, Conference on Designing Interactive Systems.

[11]  Katherine Isbister,et al.  How Games Move Us - Emotion by Design , 2016 .

[12]  Pattie Maes,et al.  BreathVR: Leveraging Breathing as a Directly Controlled Interface for Virtual Reality Games , 2018, CHI.

[13]  M. Sheelagh T. Carpendale,et al.  Self-Reflection and Personal Physicalization Construction , 2018, CHI.

[14]  Adrian Del Caro,et al.  Nietzsche: The Gay Science: With a Prelude in German Rhymes and an Appendix of Songs , 2001 .

[15]  Yvonne Rogers,et al.  Reflecting human values in the digital age , 2009, CACM.

[16]  Elisabeth André,et al.  Hold my Heart and Breathe with Me: Tangible Somaesthetic Designs , 2016, NordiCHI.

[17]  Robert Richer,et al.  Deep Reality: Towards Increasing Relaxation in VR by Subtly Changing Light, Sound and Movement Based on HR, EDA, and EEG , 2019, CHI Extended Abstracts.

[18]  Mads Møller Jensen,et al.  ChillFish: A Respiration Game for Children with ADHD , 2016, TEI.

[19]  Jon Froehlich,et al.  MakerWear: A Tangible Approach to Interactive Wearable Creation for Children , 2017, CHI.

[20]  Andrew K. Przybylski,et al.  The Motivational Pull of Video Games: A Self-Determination Theory Approach , 2006 .

[21]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[22]  Wanda Pratt,et al.  Understanding quantified-selfers' practices in collecting and exploring personal data , 2014, CHI.

[23]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[24]  E. Ferrer,et al.  Assessing cross-partner associations in physiological responses via coupled oscillator models. , 2012, Emotion.

[25]  Jun Hu,et al.  DeLight: biofeedback through ambient light for stress intervention and relaxation assistance , 2018, Personal and Ubiquitous Computing.

[26]  D. Williamson,et al.  Heart rate and blood pressure biofeedback , 1979, Biofeedback and self-regulation.

[27]  Tim McNerney,et al.  Tangible programming bricks : an approach to making programming accessible to everyone , 1999 .

[28]  Hod Lipson,et al.  Molecubes: An Open-Source Modular Robotics Kit , 2007 .

[29]  Kimiko Ryokai,et al.  Life-Affirming Biosensing in Public: Sounding Heartbeats on a Red Bench , 2019, CHI.

[30]  Y. Behar,et al.  Positive Design: An Introduction to Design for Subjective Well-Being , 2014 .

[31]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[32]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[33]  G. Davies,et al.  WS18-1 Multi-professional expertise and high performance informatics infrastructure supports innovative health technology research and clinical care in cystic fibrosis: Project Fizzyo , 2019, Journal of Cystic Fibrosis.

[34]  Jérémy Frey,et al.  Teegi: tangible EEG interface , 2014, UIST.

[35]  Diane Gromala,et al.  Sonic Cradle: designing for an immersive experience of meditation by connecting respiration to music , 2012, DIS '12.

[36]  Jérémy Frey,et al.  Inner Garden: Connecting Inner States to a Mixed Reality Sandbox for Mindfulness , 2017, CHI.

[37]  Giulio Jacucci,et al.  Heart-rate sonification biofeedback for poker , 2018, Int. J. Hum. Comput. Stud..

[38]  Michael S. Horn,et al.  Comparing the use of tangible and graphical programming languages for informal science education , 2009, CHI.

[39]  R. Reiner,et al.  Integrating a Portable Biofeedback Device into Clinical Practice for Patients with Anxiety Disorders: Results of a Pilot Study , 2008, Applied psychophysiology and biofeedback.

[40]  Matthew Louis Mauriello,et al.  BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization , 2015, CHI.

[41]  Laura A. Dabbish,et al.  Supporting Social Interactions with an Expressive Heart Rate Sharing Application , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[42]  Coye Cheshire,et al.  Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions , 2017, CSCW.

[43]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[44]  Victor R. Lee,et al.  Quantified recess: design of an activity for elementary students involving analyses of their own movement data , 2013, IDC.

[45]  Christian Mühl,et al.  Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction , 2015, Interact. Comput..

[46]  Ekaterina R. Stepanova,et al.  Virtual reality as a medium for designing and understanding transformative experiences: the case of the overview effect , 2018 .

[47]  Michael Witthöft,et al.  Contingent biofeedback outperforms other methods to enhance the accuracy of cardiac interoception: A comparison of short interventions. , 2019, Journal of behavior therapy and experimental psychiatry.

[48]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[49]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[50]  Edward B. Blanchard,et al.  Heart rate and blood pressure biofeedback: I. A review of the recent experimental literature. , 1979 .

[51]  Jessica R. Cauchard,et al.  Dišimo: Anchoring Our Breath , 2018, CHI Extended Abstracts.

[52]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[53]  Timothy S. McNerney From turtles to Tangible Programming Bricks: explorations in physical language design , 2004, Personal and Ubiquitous Computing.

[54]  Jérémy Frey,et al.  Scientific Outreach with Teegi, a Tangible EEG Interface to Talk about Neurotechnologies , 2017, CHI Extended Abstracts.

[55]  Jun Hu,et al.  Unwind: a musical biofeedback for relaxation assistance , 2018, Behav. Inf. Technol..

[56]  Raja Parasuraman,et al.  The Brain Is Faster than the Hand in Split-Second Intentions to Respond to an Impending Hazard: A Simulation of Neuroadaptive Automation to Speed Recovery to Perturbation in Flight Attitude , 2016, Front. Hum. Neurosci..

[57]  N. Farb,et al.  Interoception, contemplative practice, and health , 2015, Front. Psychol..

[58]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[59]  Jérémy Frey,et al.  TOBE: Tangible Out-of-Body Experience , 2015, TEI.

[60]  P. Desmet,et al.  Framework of product experience , 2007 .

[61]  Kenji Suzuki,et al.  bioToys: biofeedback toys for playful and self-determined physiotherapeutic activities , 2014, Artificial Life and Robotics.

[62]  Florian Mueller,et al.  Experiencing the Body as Play , 2018, CHI.

[63]  Susanne Bødker,et al.  Through the Interface: A Human Activity Approach To User Interface Design , 1990 .

[64]  Jean Vanderdonckt,et al.  AudioCubes: a distributed cube tangible interface based on interaction range for sound design , 2008, Tangible and Embedded Interaction.

[65]  Jessica R. Cauchard,et al.  Breeze: Sharing Biofeedback through Wearable Technologies , 2018, CHI.

[66]  Jieun Lee,et al.  The benefit of heart rate variability biofeedback and relaxation training in reducing trait anxiety. , 2015, Han'guk Simni Hakhoe chi. Kon'gang = The Korean journal of health psychology.

[67]  Liviu Iftode,et al.  Your Search Path Tells Others Where to Park , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[68]  R. Calvo,et al.  Positive Computing: Technology for Wellbeing and Human Potential , 2014, Psychology Teaching Review.

[69]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[70]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[71]  Bongshin Lee,et al.  Understanding self-reflection: how people reflect on personal data through visual data exploration , 2017, PervasiveHealth.

[72]  K. Yau,et al.  Interoception: the sense of the physiological condition of the body , 2003, Current Opinion in Neurobiology.

[73]  Jun Hu,et al.  BioFidget: Biofeedback for Respiration Training Using an Augmented Fidget Spinner , 2018, CHI.

[74]  Judith Amores,et al.  PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces , 2016, CHI Extended Abstracts.

[75]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[76]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[77]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[78]  Florian Mueller,et al.  Life Tree: Understanding the Design of Breathing Exercise Games , 2017, CHI PLAY.

[79]  Erik Champion,et al.  Please Biofeed the Zombies: Enhancing the Gameplay and Display of a Horror Game Using Biofeedback , 2007, DiGRA Conference.

[80]  Kristina Höök,et al.  Somaesthetic Appreciation Design , 2016, CHI.

[81]  Jörg Müller,et al.  Calming Children When Drawing Blood Using Breath-based Biofeedback , 2017, Conference on Designing Interactive Systems.

[82]  Jennifer R. Whitson Gaming the Quantified Self , 2013 .

[83]  Tomoyuki Ueno,et al.  Building blocks system for a prosthesis training of a child with congenital amputee , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[84]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[85]  E. Chandra Sekaran,et al.  Design and Development of EMG Controlled Prosthetics Limb , 2012 .

[86]  Rosalind W. Picard,et al.  BrightBeat: Effortlessly Influencing Breathing for Cultivating Calmness and Focus , 2017, CHI Extended Abstracts.

[87]  Jun Hu,et al.  LivingSurface: Biofeedback through Shape-changing Display , 2016, TEI.

[88]  Marc Hassenzahl,et al.  Towards Happiness: Possibility-Driven Design , 2012, Human-Computer Interaction: The Agency Perspective.

[89]  Jérémy Frey,et al.  Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions , 2016, CHI Extended Abstracts.

[90]  I. Wickram Biofeedback: A Practitioner's Guide , 1987 .

[91]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[92]  Gregory D. Abowd,et al.  Semi-Automated Tracking: A Balanced Approach for Self-Monitoring Applications , 2017, IEEE Pervasive Computing.