Learning to feel words: a comparison of learning approaches to acquire haptic words

Recent studies have shown that decomposing spoken or written language into phonemes and transcribing each phoneme into a unique vibrotactile pattern enables people to receive lexical messages on the arm. A potential barrier to adopting this new communication system is the time and effort required to learn the association between phonemes and vibrotactile patterns. Therefore, in this study, we compared the learnability and generalizability of different learning approaches, including guided learning, self-guided learning, and a mnemonic device. We found that after 65 minutes of learning spread across 3 days, 67% of participants, including both native and non-native English speakers, following the guided learning could identify 100 haptic words with over 90% accuracy, while only 20% of participants using the self-guided learning paradigm could do so.

[1]  Francis S. Bellezza,et al.  Mnemonic devices and natural memory , 1978 .

[2]  Karon E. MacLean,et al.  Haptic phonemes: basic building blocks of haptic communication , 2006, ICMI '06.

[3]  R E Wood,et al.  Impact of guided exploration and enactive exploration on self-regulatory mechanisms and information acquisition through electronic search. , 2001, The Journal of applied psychology.

[4]  Mark A. McDaniel,et al.  Imagery and Related Mnemonic Processes: Theories, Individual Differences, and Applications , 2011 .

[5]  Ali Israr,et al.  Efficient Evaluation of Coding Strategies for Transcutaneous Language Communication , 2018, EuroHaptics.

[6]  Robert F. Allen,et al.  Individual differences in implicit learning: Implications for the evolution of consciousness , 2000 .

[7]  Robert A. Bjork,et al.  The promise and perils of self-regulated study , 2007, Psychonomic bulletin & review.

[8]  V Bochkarev Vladimir,et al.  The average word length dynamics as an indicator of cultural changes in society , 2015 .

[9]  David Eagleman.  Plenary talks: A vibrotactile sensory substitution device for the deaf and profoundly hearing impaired , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[10]  Ali Israr,et al.  Coding Tactile Symbols for Phonemic Communication , 2018, CHI.

[11]  Mary Jo Dondlinger,et al.  Educational Video Game Design: A Review of the Literature , 2007 .

[12]  Robert H. Gault,et al.  Progress in experiments on tactual interpretation of oral speech. , 1924 .

[13]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[14]  J. Hulstijn.  THEORETICAL AND EMPIRICAL ISSUES IN THE STUDY OF IMPLICIT AND EXPLICIT SECOND-LANGUAGE LEARNING: Introduction , 2005, Studies in Second Language Acquisition.

[15]  P L Brooks,et al.  Continuing evaluation of the Queen's University tactile vocoder II: Identification of open set sentences and tracking narrative. , 1986, Journal of rehabilitation research and development.

[16]  Nate Kornell,et al.  Optimising self-regulated study: The benefits—and costs—of dropping flashcards , 2008, Memory.

[17]  Reinhold Kliegl,et al.  On the locus and process of magnification of age differences during mnemonic training. , 1990 .

[18]  F. A. Geldard.  Adventures in tactile literacy. , 1957 .

[19]  David M. Eagleman,et al.  Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput , 2015, Experimental Brain Research.

[20]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[21]  J. A. Tucker,et al.  Comparison of Retention Rates Using Traditional, Drill Sandwich, and Incremental Rehearsal Flash Card Methods , 2002 .

[22]  M. Chang.  Applying Self-Regulated Learning Strategies in a Web-Based Instruction—An Investigation of Motivation Perception , 2005 .

[23]  B. Zimmerman.  Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[24]  E. Shapiro,et al.  Differential Effects of Fixed Instructional Ratios on Students' Progress in Reading , 1991 .

[25]  P L Brooks,et al.  Acquisition of a 250-word vocabulary through a tactile vocoder. , 1985, The Journal of the Acoustical Society of America.

[26]  B. Lindblom,et al.  Role of articulation in speech perception: clues from production. , 1996, The Journal of the Acoustical Society of America.

[27]  Li-Wei Chan,et al.  EdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display , 2016, UIST.

[28]  Vladimir V. Bochkarev,et al.  Average word length dynamics as indicator of cultural changes in society , 2012, ArXiv.