Sarka: Sonification and Somaesthetic Appreciation Design

We often take for granted that we have immediate access to our perception and experience of and through our bodies. But inward listening is a demanding activity and thus not easy to learn to perform or design for. With the Sarka mat we want to support the ability to direct attention by providing sound feedback linked to the weight distribution and motion intensity of different parts of the body, and to provide an exemplar for how such design may be conducted. The process of Sarka's creation is informed by Somaesthetic Appreciation Design. We discuss how a sonic feedback signal can influence listeners, followed by how we, in this design, worked to navigate the complex design space presented to us. We detail the design process involved, and the very particular set of limitations which this interactive sonification presented.

[1]  W. Thompson,et al.  The emergence of music from the Theory of Mind , 2009 .

[2]  Elise van den Hoven,et al.  The slow floor: increasing creative agency while walking on an interactive surface , 2014, TEI '14.

[3]  Todd Ingalls,et al.  Real-Time Sonification of Movement for an Immersive Stroke Rehabilitation Environment , 2009 .

[4]  Richard Shusterman,et al.  Body Consciousness: A Philosophy of Mindfulness and Somaesthetics , 2008, The Journal of Speculative Philosophy.

[5]  Lorenzo Chiari,et al.  Audio-biofeedback for balance improvement: an accelerometry-based system , 2005, IEEE Transactions on Biomedical Engineering.

[6]  Roberto Bresin,et al.  Modes of Sonic Interaction in Circus: Three Proofs of Concept , 2014, ICMC.

[7]  Desney S. Tan,et al.  CHI '11 Extended Abstracts on Human Factors in Computing Systems , 2008, CHI 2011.

[8]  Marcelo M. Wanderley,et al.  Music and Motion: How Music-Related Ancillary Body Movements Contribute to the Experience of Music , 2009 .

[9]  Bruno Nettl.  An ethnomusicologist contemplates universals in musical sound and musical culture , 2000 .

[10]  Udo Will,et al.  The concept of entrainment and its significance for ethnomusicology , 2004 .

[11]  David Rosenboom,et al.  Biofeedback and the Arts: Results of Early Experiments , 1989 .

[12]  J. Sloboda.  Exploring the Musical MindCognition, emotion, ability, function , 2004 .

[13]  David Huron,et al.  Exploring the Musical Mind: Cognition, Emotion, Ability, Function , 2005 .

[14]  Jakob Tholander,et al.  Setting the stage - Embodied and spatial dimensions in emerging programming practices , 2009, Interact. Comput..

[15]  Victor Lazzarini.  Erratum: New Digital Musical Instruments: Control and Interaction Beyond the Keyboard , 2008, Computer Music Journal.

[16]  Anna-Karin Weivert,et al.  Music and Emotion , 2022 .

[17]  Marcelo M. Wanderley,et al.  New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series) , 2006 .

[18]  D. Levitin.  This Is Your Brain on Music , 2006 .

[19]  Ilias Bergstrom,et al.  Soma: Live Musical Performance in Which Congruent Visual, Auditory and Proprioceptive Stimuli Fuse to Form a Combined Aesthetic Narrative , 2016, Leonardo.

[20]  George Poonkhin Khut,et al.  Development and evaluation of participant-centred biofeedback artworks , 2006 .

[21]  William W. Gaver.  What should we expect from research through design? , 2012, CHI.

[22]  Kristina Höök,et al.  Somaesthetic Appreciation Design , 2016, CHI.

[23]  Erik Peper,et al.  Biofeedback an evidence based approach in clinical practice , 2009 .

[24]  R. Zatorre,et al.  Anatomically distinct dopamine release during anticipation and experience of peak emotion to music , 2011, Nature Neuroscience.

[25]  Diane Gromala,et al.  Sonic Cradle: designing for an immersive experience of meditation by connecting respiration to music , 2012, DIS '12.

[26]  Anthony Steed,et al.  Mutable mapping: gradual re-routing of OSC control data as a form of artistic performance , 2009, Advances in Computer Entertainment Technology.

[27]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[28]  Daniel C. Johnson,et al.  Exploring the musical mind : cognition, emotion, ability, function , 2006 .

[29]  Matthew Wright,et al.  Open Sound Control: an enabling technology for musical networking , 2005, Organised Sound.

[30]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[31]  Thecla Schiphorst,et al.  Self-evidence: applying somatic connoisseurship to experience design , 2011, CHI Extended Abstracts.

[32]  Terri L. Bonebright,et al.  Sonific ation Report: Status of the Field and Research Agenda , 2010 .

[33]  Kristina Höök,et al.  Metaphone: machine aesthetics meets interaction design , 2014, CHI.

[34]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[35]  Sofia Seinfeld,et al.  Using music as a signal for biofeedback. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Stanley R. Hauer,et al.  The Rest Is Noise: Listening to the Twentieth Century , 2008 .

[37]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.