Sonification approaches in sports in the past decade: a literature review

The raise of novel mobile sensor and actuator technologies in the past decade enabled sonification of sport related data in real time for the athlete. We have systematically analysed scientific literature with respect to sports domains, feedback goals, user types, used sensor technology, and how the captured sensor data was sonified. We describe these aspects of 34 selected papers. Our analysis enables researchers to grasp prevalent approaches and to identify blind spots for new ways how sonification can not only aid athletes to improve their performance, but also to enhance the experience of various sports practitioners through sonification.

[1]  Kazuya Murao,et al.  Training system of bicycle pedaling using auditory feedback , 2015, Advances in Computer Entertainment.

[2]  Jeffrey Heer,et al.  Balancing exertion experiences , 2012, CHI.

[3]  P. Cesari,et al.  Sound matters: The impact of auditory deprivation on movement precision in rowing , 2020, European journal of sport science.

[4]  Garth Paine,et al.  Interactive Tango Milonga: designing internal experience , 2015, MOCO.

[5]  Daniel Hug,et al.  Bringing musicality to movement sonification: design and evaluation of an auditory swimming coach , 2013, AM '13.

[6]  Kristina Höök Soma Design - Intertwining Aesthetics, Ethics and Movement , 2020, Tangible and Embedded Interaction.

[7]  Makoto Sato,et al.  Realtime sonification of the center of gravity for skiing , 2012, AH '12.

[8]  Nina Schaffert,et al.  Interactive Sonification in Rowing: Acoustic Feedback for On-Water Training , 2015, IEEE MultiMedia.

[9]  Stephan Wensveen,et al.  Embodying complexity through movement sonification: case study on empowering the speed-skater , 2011, CHItaly.

[10]  Andy Hunt,et al.  Assisting Dumbbell Curls via Interactive Sonification of Arm Movement and Muscular Signals , 2019 .

[11]  A. Tajadura As Light as You Aspire to Be : Changing Body Perception with Sound to Support Physical Activity , 2019 .

[12]  Balaji Thoshkahna,et al.  Real-time heart rate sonification for athletes , 2015, ICAD.

[13]  Andrea Giomi,et al.  Listening Touch: A Case Study about Multimodal Awareness in Movement Analysis with Interactive Sound Feedback , 2018, MOCO.

[14]  Jeffrey E. Boyd,et al.  Audio Visual Synchronization of Rhythm , 2015, 2015 International Conference on 3D Vision.

[15]  Andy Hunt,et al.  Interactive sonification , 2012, Journal on Multimodal User Interfaces.

[16]  Bruce N. Walker,et al.  Soccer Sonification: Enhancing Viewer Experience , 2019 .

[17]  Andy Hunt,et al.  Real-time Sonification of Biceps Curl Exercise Using Muscular Activity and Kinematics , 2015, ICAD.

[18]  Steven Landry,et al.  Tempo-Fit heart rate app: Using heart rate Sonification as exercise performance feedback , 2016, ICAD 2016.

[19]  Jessica Hummel,et al.  Interactive sonification of German wheel sports movements , 2009 .

[20]  Nina Schaffert,et al.  The sound of Rowing Stroke Cycles as Acoustic Feedback , 2011 .

[21]  Jean-Baptiste de la Rivière,et al.  Interactions and systems for augmenting a live dance performance , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[22]  Thecla Schiphorst,et al.  Vocalizing dance movement for interactive sonification of laban effort factors , 2014, Conference on Designing Interactive Systems.

[23]  Myounghoon Jeon,et al.  Participatory Design Research Methodologies: A Case Study in Dancer Sonification , 2017 .

[24]  Courtney Brown Machine Tango: An Interactive Tango Dance Performance , 2019, Tangible and Embedded Interaction.

[25]  Jeffrey E. Boyd,et al.  Rhythmic Sonic Feedback for Speed Skating by Real-Time Movement Synchronization , 2012, Int. J. Comput. Sci. Sport.

[26]  Roberto Bresin,et al.  Sonification of sculler movements, development of preliminary methods , 2010 .

[27]  Jennifer G. Sheridan,et al.  Jogging over a distance between Europe and Australia , 2010, UIST.

[28]  Nina Schaffert,et al.  The sound of the underwater dolphin-kick: developing real-time audio feedback in swimming , 2019, Displays.

[29]  Maria-Karoliina Tiuraniemi Guiding Divers with Sound , 2011 .

[30]  Jeffrey E. Boyd,et al.  CORRECTIVE SONIC FEEDBACK FOR SPEED SKATING: A CASE STUDY , 2010 .

[31]  Andrew Godbout,et al.  Towards an application of interactive sonification for the forces applied on the pedals during cycling on the Wattbike ergometer , 2017, Displays.

[32]  John G. Neuhoff,et al.  Parameter Mapping Sonification , 2011 .

[33]  Peter Wolf,et al.  Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning , 2014, Experimental Brain Research.

[34]  Spencer Topel,et al.  SonicTaiji: A Mobile Instrument for Taiji Performance , 2014 .

[35]  Gaël Dubus Evaluation of four models for the sonification of elite rowing , 2011, Journal on Multimodal User Interfaces.

[36]  Markus Cslovjecsek,et al.  Towards an Enactive Swimming Sonification: Exploring Multisensory Design and Musical Interpretation , 2015, AM '15.

[37]  Andrew Godbout,et al.  The sound of the pedal stroke cycle: Sonification of the Wattbike cycling ergometer , 2015, ICAD.

[38]  Nina Schaffert,et al.  Examining effects of acoustic feedback on perception and modification of movement patterns in on-water rowing training , 2011, AM '11.

[39]  Ana Tajadura-Jiménez,et al.  As Light as You Aspire to Be: Changing Body Perception with Sound to Support Physical Activity , 2019, CHI.

[40]  Andrew Godbout,et al.  Mobile Sonification for Athletes: A Case Study in Commercialization of Sonification , 2014 .

[41]  Thomas Hermann,et al.  Sonification of Pressure Changes in Swimming for Analysis and Optimization , 2012 .

[42]  Thomas Hermann,et al.  Swimmers in the loop: Sensing moving water masses for an auditory biofeedback system , 2015, 2015 IEEE Sensors Applications Symposium (SAS).

[43]  Nadia Bianchi-Berthouze,et al.  Musical Expectancy in Squat Sonification for People Who Struggle with Physical Activity , 2017 .

[44]  Marco Avvenuti,et al.  A Smartphone Based Sonification And Telemetry Platform For On-Water Rowing Training , 2013 .