An Adaptive Metronome Technique for Mitigating the Impact of Latency in Networked Music Performances

The improvement of digital communication networks increased the interest towards Networked Music Performance both for entertainment and education. One of the main issues that affects the effectiveness of remote performances is the inherent network latency in the communication chain. In this paper we propose a technique that, to the best of our knowledge, is the first work that explores the use of adaptive metronomes in order to track the tempo of the musicians and help them in coping with the latency. We test our proposal with preliminary experiments in the context of chamber music.

[1]  Chris Chafe,et al.  To the Edge with China: Explorations in Network Performance , 2008 .

[2]  Luca Turchet,et al.  Smart Musical Instruments: Vision, Design Principles, and Future Directions , 2019, IEEE Access.

[3]  U. Peter Svensson,et al.  Ensemble Hand-Clapping Experiments under the Influence of Delay and Various Acoustic Environments , 2006 .

[4]  Carlo Drioli,et al.  Networked Performances and Natural Interaction via LOLA: Low Latency High Quality A/V Streaming System , 2013, ECLAP.

[5]  Chris Chafe,et al.  Simulation of Networked Ensemble Performance with Varying Time Delays: Characterization of Ensemble Accuracy , 2004, ICMC.

[6]  Augusto Sarti,et al.  A Presence- and Performance-Driven Framework to Investigate Interactive Networked Music Learning Scenarios , 2019, Wirel. Commun. Mob. Comput..

[7]  Chris Chafe,et al.  Network Time Delay and Ensemble Accuracy: Effects of Latency, Asymmetry , 2004 .

[8]  Carlo Fischione,et al.  Internet of Musical Things: Vision and Challenges , 2018, IEEE Access.

[9]  Stefano Delle Monache,et al.  Time is not on my side: Network latency, presence and performance in remote music interaction , 2019 .

[10]  Rebecca Fiebrink,et al.  The Global Metronome: Absolute Tempo Sync For Networked Musical Performance , 2016, NIME.

[11]  Patrick G. T. Healey,et al.  A new medium for remote music tuition , 2017 .

[12]  lvaro Barbosa,et al.  Displaced Soundscapes: A Survey of Network Systems for Music and Sonic Art Creation , 2003, Leonardo Music Journal.

[13]  Augusto Sarti,et al.  Feature-Based Analysis of the Effects of Packet Delay on Networked Musical Interactions , 2015 .

[14]  Alexander Carôt,et al.  "Network Music Performance - Problems, Approaches and Perspectives" , 2007 .

[15]  Augusto Sarti,et al.  Investigating Networked Music Performances in Pedagogical Scenarios for the InterMUSIC Project , 2018, 2018 23rd Conference of Open Innovations Association (FRUCT).

[16]  Allison Littlejohn,et al.  Instructional quality of Massive Open Online Courses (MOOCs) , 2015, Comput. Educ..

[17]  Chris Chafe,et al.  JackTrip: Under the Hood of an Engine for Network Audio , 2010, ICMC.

[18]  Petr Holub,et al.  High-definition multimedia for multiparty low-latency interactive communication , 2006, Future Gener. Comput. Syst..

[19]  Chris Chafe,et al.  Effect of Time Delay on Ensemble Accuracy , 2004 .

[20]  Don Knox,et al.  Challenges of using Networked Music Performance in education , 2015 .

[21]  John Wawrzynek,et al.  A case for network musical performance , 2001, NOSSDAV '01.

[22]  Anton Nijholt,et al.  Interacting with a Virtual Conductor , 2006, ICEC.

[23]  Nicolas Bouillot,et al.  nJam user experiments: enabling remote musical interaction from milliseconds to seconds , 2007, NIME '07.

[24]  Chris Chafe,et al.  Effect of Temporal Separation on Synchronization in Rhythmic Performance , 2010, Perception.

[25]  Augusto Sarti,et al.  Multipath Beat Tracking , 2016 .

[26]  Augusto Sarti,et al.  An Overview on Networked Music Performance Technologies , 2016, IEEE Access.

[27]  Lucas Beyer,et al.  Effect of a Global Metronome on Ensemble Accuracy in Networked Music Performance , 2019 .