Scratch-Off: A Gesture Based Mobile Music Game with Tactile Feedback

This paper presents “Scratch-Off”, a new musical multiplayer DJ game that has been designed for a mobile phone. We describe how the game is used as a test platform for experimenting with various types of multimodal feedback. The game uses movement gestures made by the players to scratch a record and control crossfades between tracks, with the objective of the game to make the correct scratch at the correct time in relation to the music. Gestures are detected using the devices built-in tri-axis accelerometer and multi-touch screen display. The players receive visual, audio and various types of vibrotactile feedback to help them make the correct scratch on the beat of the music track. We also discuss the results of a pilot study using this interface.

[1]  Chris Chafe,et al.  Playing by feel: incorporating haptic feedback into computer-based musical instruments , 2001 .

[2]  Karon E. MacLean,et al.  Manipulating music: multimodal interaction for DJs , 2004, CHI '04.

[3]  Hans-Werner Gellersen,et al.  The ColorDex DJ system: a new interface for live music mixing , 2007, NIME '07.

[4]  Roderick Murray-Smith,et al.  Rhythmic Interaction for Song Filtering on a Mobile Device , 2006, HAID.

[5]  Roderick Murray-Smith,et al.  Dynamics of tilt-based browsing on mobile devices , 2007, CHI Extended Abstracts.

[6]  Michael Lew,et al.  Live Cinema: Designing an Instrument for Cinema Editing as a Live Performance , 2004, NIME.

[7]  Michael Rohs,et al.  Shamus - a Sensor-Based Integrated Mobile phone Instrument , 2007, ICMC.

[8]  Kjetil Falkenberg Hansen,et al.  Mapping strategies in DJ scratching , 2006, NIME.

[9]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[10]  Nikita Pashenkov,et al.  A New Mix of Forgotten Technology: Sound Generation, Sequencing and Performance Using an Optical Turntable , 2004, NIME.

[11]  Andreas Pabst,et al.  Augmenting a rugged standard DJ turntable with a tangible interface for music browsing and playback manipulation , 2007 .

[12]  Spencer Kiser.  spinCycle: a Color-Tracking Turntable Sequencer , 2006, NIME.

[13]  Takuro Mizuta Lippit,et al.  Turntable Music in the Digital Era: Designing Alternative Tools for New Turntable Expression , 2006, NIME.