A Low-Cost, Low-Latency Multi-Touch Table with Haptic Feedback for Musical Applications

During the past decade, multi-touch surfaces have emerged as valuable tools for collaboration, display, interaction, and musical expression. Unfortunately, they tend to be costly and often suffer from two drawbacks for music performance: (1) relatively high latency owing to their sensing mechanism, and (2) lack of haptic feedback. We analyze the latency present in several current multi-touch platforms, and we describe a new custom system that reduces latency to an average of 30 ms while providing programmable haptic feedback to the user. The paper concludes with a description of ongoing and future work.

[1]  Daniel J. Levitino,et al.  The Perception of Cross-Modal Simultaneity , 2001 .

[2]  Elizabeth M. Wenzel,et al.  Analysis of the Role of Update Rate and System Latency in Interactive Virtual Acoustic Environments , 1997 .

[3]  Yvonne Jansen.  Mudpad: fluid haptics for multitouch surfaces , 2010, CHI EA '10.

[4]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[5]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[6]  Dimitris N. Metaxas,et al.  Feel the "fabric": an audio-haptic interface , 2003, SCA '03.

[7]  L. Harris,et al.  The effect of exposure to asynchronous audio, visual, and tactile stimulus combinations on the perception of simultaneity , 2008, Experimental Brain Research.

[8]  Mark Freeman,et al.  Revisiting Cagean Composition Methodology with a Modern Computational Implementation , 2010, NIME.

[9]  Abdulmotaleb El-Saddik,et al.  A guided tour in haptic audio visual environments and applications , 2007, Int. J. Adv. Media Commun..

[10]  K. Scherer,et al.  EMOTIONAL EFFECTS OF MUSIC: PRODUCTION RULES , 2001 .

[11]  Fabio Kon,et al.  The Quest for Low Latency , 2004, ICMC.

[12]  Andreas Butz,et al.  Physical handles at the interactive surface: exploring tangibility and its benefits , 2008, AVI '08.

[13]  Chris Gunn,et al.  Combating Latency in Haptic Collaborative Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[14]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[15]  Durand R. Begault,et al.  Sensitivity to haptic-audio asynchrony , 2003, ICMI '03.

[16]  William L. Martens,et al.  Perception of Simultaneity and Detection of Asynchrony between Audio and Structural Vibration in Multimodal Music Reproduction , 2006 .

[17]  Perttu Hämäläinen,et al.  Latency Tolerance for Gesture Controlled Continuous Sound Instrument without Tactile Feedback , 2004, ICMC.

[18]  Chris Harrison,et al.  Providing dynamically changeable physical buttons on a visual display , 2009, CHI.

[19]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[20]  Alexander Refsum Jensenius,et al.  Proceedings of the International Conference on New Interfaces for Musical Expression , 2011 .

[21]  Patrick Olivier,et al.  Building Interactive Multi-touch Surfaces , 2010, Tabletops.

[22]  Dinesh K. Pai,et al.  The AHI: an audio and haptic interface for contact interactions , 2000, UIST '00.

[23]  Perttu Hämäläinen,et al.  EFFECT OF LATENCY ON PLAYING ACCURACY OF TWO GESTURE CONTROLLED CONTINUOUS SOUND INSTRUMENTS WITHOUT TACTILE FEEDBACK , 2004 .