Crossmodal Rhythm Perception

Research on rhythm perception has mostly been focused on the auditory and visual modalities. Previous studies have shown that the auditory modality dominates rhythm perception. Rhythms can also be perceived through the tactile senses, for example, as vibrations, but only few studies exist. We investigated unimodal and crossmodal rhythm perception with auditory, tactile, and visual modalities. Pairs of rhythm patterns were presented to the subject who made a same-different judgment. We used all possible combinations of the three modalities. The results showed that the unimodal auditory condition had the highest rate (79.2%) of correct responses. The unimodal tactile condition (75.0%) and the auditory-tactile condition (74.2%) were close. The average rate remained under 61.7% when the visual modality was involved. The results confirmed that auditory and tactile modalities are suitable for presenting rhythmic information, and they are also preferred by the users.

[1]  Arthur M. Glenberg,et al.  Modality effects in the coding reproduction of rhythms , 1989 .

[2]  G. Logan,et al.  Modality differences in short-term memory for rhythms , 2000, Memory & cognition.

[3]  Stephen A. Brewster,et al.  The design and evaluation of a vibrotactile progress bar , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[4]  Menachem Jona,et al.  Temporal coding in rhythm tasks revealed by modality effects , 1991, Memory & cognition.

[5]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[6]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[7]  Roope Raisamo,et al.  Distinguishing Vibrotactile Effects with Tactile Mouse and Trackball , 2005, BCS HCI.

[8]  Masanori Sugimoto,et al.  T-RHYTHM: a system for supporting rhythm learning by using tactile devices , 2005, IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE'05).