As Light as You Aspire to Be: Changing Body Perception with Sound to Support Physical Activity

Supporting exercise adherence through technology remains an important HCI challenge. Recent works showed that altering walking sounds leads people perceiving themselves as thinner/lighter, happier and walking more dynamically. While this novel approach shows potential for physical activity, it raises critical questions impacting technology design. We ran two studies in the context of exertion (gym-step, stairs-climbing) to investigate how individual factors impact the effect of sound and the duration of the after-effects. The results confirm that the effects of sound in body-perception occur even in physically demanding situations and through ubiquitous wearable devices. We also show that the effect of sound interacted with participants' body weight and masculinity/femininity aspirations, but not with gender. Additionally, changes in body-perceptions did not hold once the feedback stopped; however, body-feelings or behavioural changes appeared to persist for longer. We discuss the results in terms of malleability of body-perception and highlight opportunities for supporting exercise adherence.

[1]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[2]  R. Iman,et al.  Rank Transformations as a Bridge between Parametric and Nonparametric Statistics , 1981 .

[3]  R. J. Sonstroem Exercise and Self‐Esteem , 1984, Exercise and sport sciences reviews.

[4]  W. Morgan,et al.  Exercise and self-esteem: rationale and model. , 1989, Medicine and science in sports and exercise.

[5]  M. Bradley,et al.  Emotion, attention, and the startle reflex. , 1990, Psychological review.

[6]  Robert J. Logan,et al.  Perception of acoustic source characteristics: walking sounds. , 1991, The Journal of the Acoustical Society of America.

[7]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[8]  M. Tiggemann Gender differences in the interrelationships between weight dissatisfaction, restraint, and self-esteem , 1994 .

[9]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[10]  V. Jousmäki,et al.  Parchment-skin illusion: sound-biased touch , 1998, Current Biology.

[11]  H. Remschmidt,et al.  Body image distortion in Anorexia Nervosa – is there really a perceptual deficit? , 1999, European Child & Adolescent Psychiatry.

[12]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[13]  N. Owen,et al.  Obesity as a barrier to physical activity , 2000 .

[14]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[15]  Albert V. Carron,et al.  The Psychology of Physical Activity , 2002 .

[16]  D. Spurrett What about embodiment? , 2003, Behavioral and Brain Sciences.

[17]  Helge J. Ritter,et al.  Sound and meaning in auditory data display , 2004, Proceedings of the IEEE.

[18]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[19]  A. Flouris,et al.  Developmental coordination disorder, generalized self-efficacy toward physical activity, and participation in organized and free play activities. , 2005, The Journal of pediatrics.

[20]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[21]  P. Larsson Virtually hearing, seeing, and being: Room acoustics, presence and audiovisual environments , 2005 .

[22]  P. Haggard,et al.  Bodily Illusions Modulate Tactile Perception , 2005, Current Biology.

[23]  Bruno L. Giordano,et al.  Walking and playing: what's the origin of emotional expressiveness in music? , 2006 .

[24]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[25]  S. Ebrahim,et al.  Globalization of Behavioral Risks Needs Faster Diffusion of Interventions , 2007, Preventing chronic disease.

[26]  Stuart J. H. Biddle,et al.  Psychology of physical activity: Determinants, well-being and interventions (3rd Edition) , 2007 .

[27]  P. Haggard,et al.  Viewing the body modulates tactile receptive fields , 2007, Experimental Brain Research.

[28]  L. Vartanian,et al.  Effects of Weight Stigma on Exercise Motivation and Behavior , 2008, Journal of health psychology.

[29]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[30]  R. Pastore,et al.  Auditory event perception: The source—perception loop for posture in human gait , 2008, Perception & psychophysics.

[31]  Hylton B Menz,et al.  Accelerometry: a technique for quantifying movement patterns during walking. , 2008, Gait & posture.

[32]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[33]  Stefania Serafin,et al.  Sound design and perception in walking interactions , 2009, Int. J. Hum. Comput. Stud..

[34]  Robert Höldrich,et al.  PhysioSonic - Evaluated Movement Sonification as Auditory Feedback in Physiotherapy , 2009, CMMR/ICAD.

[35]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[36]  Amy J. C. Cuddy,et al.  Power Posing , 2010, Psychological science.

[37]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[38]  Nina Schaffert,et al.  Listen to the boat motion: acoustic information for elite rowers , 2010 .

[39]  Hal E. Hershfield,et al.  Increasing Saving Behavior Through Age-Progressed Renderings of the Future Self , 2011, JMR, Journal of marketing research.

[40]  C. Matthews,et al.  Sedentary time and cardio-metabolic biomarkers in US adults: NHANES 2003-06. , 2011, European heart journal.

[41]  N. Troje,et al.  Differences in the Nature of Body Image Disturbances Between Female Obese Individuals With Versus Without a Comorbid Binge Eating Disorder: An Exploratory Study Including Static and Dynamic Aspects of Body Image , 2011, Behavior modification.

[42]  I. Viaud-Delmon,et al.  A Sounding Body in a Sounding Space: the Building of Space in Choreography – Focus on Auditory-motor Interactions , 2011 .

[43]  Bettina Bläsing,et al.  Wearable Sensor-Based Real-Time Sonification of Motion and Foot Pressure in Dance Teaching and Training , 2012 .

[44]  K. Khunti,et al.  Sedentary time in adults and the association with diabetes, cardiovascular disease and death: systematic review and meta-analysis , 2012, Diabetologia.

[45]  David G. Kerwin,et al.  Towards real-time profiling of sprints using wearable pressure sensors , 2012, Comput. Commun..

[46]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[47]  M. Tsakiris,et al.  Action sounds recalibrate perceived tactile distance , 2012, Current Biology.

[48]  M. Hirose,et al.  Interactonia Balloon , 2012, SIGGRAPH Asia Emerging Technologies.

[49]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[50]  Judy Edworthy,et al.  Medical audible alarms: a review , 2013, J. Am. Medical Informatics Assoc..

[51]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[52]  Agnieszka Roginska Auditory icons, earcons, and displays: Information and expression through sound , 2013 .

[53]  Giulio Rosati,et al.  On the Role of Auditory Feedback in Robot-Assisted Movement Training after Stroke: Review of the Literature , 2013, Comput. Intell. Neurosci..

[54]  Z. Sui,et al.  Physical activity levels during pregnancy and gestational weight gain among women who are overweight or obese. , 2013, Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals.

[55]  A. Seth Interoceptive inference, emotion, and the embodied self , 2013, Trends in Cognitive Sciences.

[56]  Yosuke Kurihara,et al.  Virtual Robotization of the Human Body via Data-Driven Vibrotactile Feedback , 2013, Advances in Computer Entertainment.

[57]  Ana Tajadura-Jiménez,et al.  Motivating people with chronic pain to do physical activity: opportunities for technology design , 2014, CHI.

[58]  N. Bolognini,et al.  The Marble-Hand Illusion , 2013, PloS one.

[59]  Nadia Bianchi-Berthouze,et al.  Tracking physical activity: problems related to running longitudinal studies with commercial devices , 2014, UbiComp Adjunct.

[60]  Bruno L. Giordano,et al.  The Production and Perception of Emotionally Expressive Walking Sounds: Similarities between Musical Performance and Everyday Motor Activity , 2014, PloS one.

[61]  Michael J. Black,et al.  Can I Recognize My Body's Weight? The Influence of Shape and Texture on the Perception of Self , 2014, ACM Trans. Appl. Percept..

[62]  C. Spence,et al.  Modifying action sounds influences people's emotional responses and bodily sensations , 2014, i-Perception.

[63]  Thecla Schiphorst,et al.  Vocalizing dance movement for interactive sonification of laban effort factors , 2014, Conference on Designing Interactive Systems.

[64]  A. P. Belon,et al.  How community environment shapes physical activity: perceptions revealed through the PhotoVoice method. , 2014, Social science & medicine.

[65]  S. Roddy,et al.  Embodied Aesthetics in Auditory Display , 2014, Organised Sound.

[66]  M. Tsakiris,et al.  Action sounds update the mental representation of arm dimension: contributions of kinaesthesia and agency , 2015, Front. Psychol..

[67]  C. Shieh,et al.  Association of Self-Efficacy and Self-Regulation with Nutrition and Exercise Behaviors in a Community Sample of Adults , 2015, Journal of community health nursing.

[68]  C. Urgesi,et al.  Distinct contributions of extrastriate body area and temporoparietal junction in perceiving one’s own and others’ body , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[69]  I. Janssen The Economic Cost of Physical Inactivity , 2015 .

[70]  Ana Tajadura-Jiménez,et al.  Sonification of Surface Tapping Changes Behavior, Surface Perception, and Emotion , 2015, IEEE MultiMedia.

[71]  Ana Tajadura-Jiménez,et al.  As Light as your Footsteps: Altering Walking Sounds to Change Perceived Body Weight, Emotional State and Gait , 2015, CHI.

[72]  Michael Madary,et al.  Real Virtuality: A Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of VR-Technology , 2016, Front. Robot. AI.

[73]  Ana Tajadura-Jiménez,et al.  Go-with-the-Flow: Tracking, Analysis and Sonification of Movement and Breathing to Build Confidence in Activity Despite Chronic Pain , 2016, Hum. Comput. Interact..

[74]  D. Swapp,et al.  Action Sounds Modulate Arm Reaching Movements , 2016, Front. Psychol..

[75]  E. Boesch,et al.  The effect of bodily illusions on clinical pain: a systematic review and meta-analysis , 2016, Pain.

[76]  Ana Tajadura-Jiménez,et al.  Musically Informed Sonification for Chronic Pain Rehabilitation: Facilitating Progress & Avoiding Over-Doing , 2016, CHI.

[77]  Luca Turchet,et al.  Footstep sounds synthesis: Design, implementation, and evaluation of foot–floor interactions, surface materials, shoe types, and walkers’ features , 2016 .

[78]  Corrigendum: Action Sounds Modulate Arm Reaching Movements , 2016, Front. Psychol..

[79]  Marie Schmidt,et al.  HEAL TH AT A GLANCE , 2007 .

[80]  Sally A. Linkenauger,et al.  Multimodal contributions to body representation , 2016 .

[81]  Agnès Roby-Brami,et al.  Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies , 2022 .

[82]  Wijnand A. IJsselsteijn,et al.  Personal Informatics, Self-Insight, and Behavior Change: A Critical Review of Current Literature , 2017, Hum. Comput. Interact..

[83]  M. Slater,et al.  Embodiment in a Child-Like Talking Virtual Body Influences Object Size Perception, Self-Identification, and Subsequent Real Speaking , 2017, Scientific Reports.

[84]  N. Bianchi-Berthouze,et al.  Contingent sounds change the mental representation of one’s finger length , 2017, Scientific Reports.

[85]  Amy LaViers,et al.  Empirically Informed Sound Synthesis Application for Enhancing the Perception of Expressive Robotic Movement , 2017 .

[86]  N. Bianchi-Berthouze,et al.  Bodily Sensory Inputs and Anomalous Bodily Experiences in Complex Regional Pain Syndrome: Evaluation of the Potential Effects of Sound Feedback , 2017, Front. Hum. Neurosci..

[87]  Nadia Bianchi-Berthouze,et al.  Supporting Everyday Function in Chronic Pain Using Wearable Technology , 2017, CHI.

[88]  H. Ehrsson,et al.  Auditory Cues Influence the Rubber-Hand Illusion , 2018, Journal of experimental psychology. Human perception and performance.

[89]  N. Bianchi-Berthouze,et al.  Audio-tactile cues from an object’s fall change estimates of one’s body height , 2018, PloS one.