Hands on music: physical approach to interaction with digital music

Mobile users listen to large digital music libraries with thousands of songs. Browsing such libraries in mobile contexts is difficult due to constraints of the context and devices. We explore the usage of physical interaction with digital music to overcome these limitations. Our solution is to utilize the physical orientation of a mobile device as a tool for exploring music. We focus on allowing users to manage their music for easier mobile access. We present a novel bimanual interaction method for mapping items from a music library into different orientations of the mobile device. An experiment was conducted to test our prototype, focusing on efficiency and impact on users' ability to recall locations of items in the mapping. The interaction method was found to be significantly faster than using a touch screen without the mobile device. Subjectively users valued the bimanual method in ease of use, efficiency, and pleasantness.

[1]  Jarmo Hiipakka,et al.  A SPATIAL AUDIO USER INTERFACE FOR GENERATING MUSIC PLAYLISTS , 2003 .

[2]  Stefan Leitich,et al.  Globe of Music - Music Library Visualization Using Geosom , 2007, ISMIR.

[3]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[4]  Jaakko Keränen,et al.  Gravity sphere: gestural audio-tactile interface for mobile music exploration , 2009, CHI.

[5]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[6]  Frank Bentley,et al.  Personal vs. commercial content: the similarities between consumer use of photos and music , 2006, CHI.

[7]  Ravin Balakrishnan,et al.  Exploring bimanual camera control and object manipulation in 3D graphics interfaces , 1999, CHI '99.

[8]  Berry Eggen,et al.  Programming and enjoying music with your eyes closed , 2000, CHI.

[9]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[10]  Ehud Sharlin,et al.  On tangible user interfaces, humans and spatiality , 2004, Personal and Ubiquitous Computing.

[11]  William Buxton,et al.  Graspable user interfaces , 1996 .

[12]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[13]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[14]  Joe Tullio,et al.  Usability analysis of 3D rotation techniques , 1997, UIST '97.

[15]  Bernhard Preim,et al.  Usability Comparison of Mouse-Based Interaction Techniques for Predictable 3d Rotation , 2005, Smart Graphics.

[16]  M. Witko,et al.  Sixth International Symposium. Effects of surface heterogeneity in adsorption and catalysis on solids—ISSHAC VI, Zakopane, Poland, 28th August-2nd September 2006 , 2007 .

[17]  Brad A. Myers,et al.  Using handhelds and PCs together , 2001, CACM.

[18]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[19]  Shumin Zhai,et al.  Manual and cognitive benefits of two-handed input: an experimental study , 1998, TCHI.

[20]  Andreas Rauber,et al.  PlaySOM and PocketSOMPlayer, Alternative Interfaces to Large Music Collections , 2005, ISMIR.

[21]  Miguel Bruns Alonso,et al.  MusicCube: making digital music tangible , 2005, CHI EA '05.