EFFECT OF LATENCY ON PLAYING ACCURACY OF TWO GESTURE CONTROLLED CONTINUOUS SOUND INSTRUMENTS WITHOUT TACTILE FEEDBACK

The paper reports results from an experimental study quantifying how latency affects the playing accuracy of two continuous sound instruments. 11 subjects played a conventional Theremin and a virtual reality Theremin. Both instruments provided the user only audio feedback. The subjects performed two tasks under different instrument latencies. They attempted to match the pitch of the instrument to a sample pitch and they played along a short sample melody and a metronome. Both the sample sound and the instrument’s sound were recorded on different channels of a sound file. Later the pitch of the sounds was extracted and user performance analyzed. The results show that the time required to match a given pitch degrades about five times the introduced latency suggesting that the feedback latency cumulates over the whole task. Errors while playing along a sample melody increased 80% by average on the highest latency of 240ms. Latencies until 120ms increased the errors only slightly.

[1]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[2]  I. Scott MacKenzie,et al.  Movement time prediction in human-computer interfaces , 1992 .

[3]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[4]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[5]  Roel Vertegaal,et al.  Comparison of Input Devices in an ISEE Direct Timbre Manipulation Task , 1996, Interact. Comput..

[6]  S. Finney,et al.  Auditory Feedback and Musical Keyboard Performance , 1997 .

[7]  Amar Chaudhary,et al.  Operating Systems Latency Measurement and Analysis for Sound Synthesis and Processing Applications , 1997, ICMC.

[8]  Axel G. E. Mulder.  Design of virtual three-dimensional instruments for sound control , 1998 .

[9]  William Ribarsky,et al.  Effects of Variation in System Responsiveness on User Performance in Virtual Environments , 1998, Hum. Factors.

[10]  William Ribarsky,et al.  Managing temporal detail in virtual environments: relating system responsiveness to feedback , 1999, CHI EA '99.

[11]  Marcelo M. Wanderley,et al.  Towards a Model for Instrumental Mapping in Expert Musical Interaction , 2000, ICMC.

[12]  Insook Choi,et al.  A Manifold Interface for Kinesthetic Notation in High-Dimensional Systems , 2000 .

[13]  Chris Chafe,et al.  Playing by feel: incorporating haptic feedback into computer-based musical instruments , 2001 .

[14]  Roberto Bresin,et al.  IS THE PLAYER MORE INFLUENCED BY THE AUDITORY THAN THE TACTILE FEEDBACK FROM THE INSTRUMENT , 2001 .

[15]  James L. Wright,et al.  System-Level MIDI Performance Testing , 2001, ICMC.

[16]  Marcelo M. Wanderley,et al.  The Importance of Parameter Mapping in Electronic Instrument Design , 2002, NIME.

[17]  A. A. Sawchuk,et al.  From remote media immersion to Distributed Immersive Performance , 2003, ETP '03.

[18]  Perttu Hämäläinen,et al.  Latency Tolerance for Gesture Controlled Continuous Sound Instrument without Tactile Feedback , 2004, ICMC.