Incidental Categorization of Vibrotactile Stimuli

Past research has demonstrated incidental learning of task-irrelevant visual and auditory stimuli. Motivated by the possibility of similar evidence in the tactile domain and potential applications in tactile speech communication systems, we investigated incidental categorization of vibrotactile stimuli through a visuomotor task of shape identification. Two experiments were conducted where participants were exposed to position-based or movement-based vibrotactile stimuli prior to performing a speeded response to one of two targets. The two experiments differed only in the particular sets of such stimuli employed. Unbeknownst to the participants, the vibrotactile stimuli and visual targets were initially correlated perfectly to facilitate the incidental learning of their associations, briefly uncorrelated to check the cost in reaction time, and correlated again to re-establish the initial association. Finally, participants were asked to predict visual targets from novel position-based and movement-based stimuli. The results from both experiments provided evidence of incidental categorization of vibrotactile stimuli. The percent-correct scores and sensitivity indices for the overt categorization of novel stimuli from both experiments were well above chance, indicating generalization of learning. And while both experiments showed an increase in reaction time when the association between vibrotactile stimuli and visual targets was disrupted, this reaction time cost was significant only for the stimuli used in the second experiment. Our finding of incidental categorization in the tactile domain has important implications for the effective acquisition of speech in tactile speech communication systems.

[1]  Lori L Holt,et al.  Incidental auditory category learning. , 2015, Journal of experimental psychology. Human perception and performance.

[2]  Aaron R. Seitz,et al.  Unattended exposure to components of speech sounds yields same benefits as explicit auditory training , 2010, Cognition.

[3]  Takeo Watanabe,et al.  Perceptual learning without perception , 2001, Nature.

[4]  Thad Starner,et al.  Towards Passive Haptic Learning of piano songs , 2015, 2015 IEEE World Haptics Conference (WHC).

[5]  Aaron R. Seitz,et al.  The phenomenon of task-irrelevant perceptual learning , 2009, Vision Research.

[6]  José E. Náñez,et al.  Greater plasticity in lower-level than higher-level visual motion processing in a passive perceptual learning task , 2002, Nature Neuroscience.

[7]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[8]  Hong Z. Tan,et al.  Validity of haptic cues and its effect on priming visual spatial attention , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[9]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[10]  Sung-joo Lim,et al.  Role of the striatum in incidental learning of sound categories , 2019, Proceedings of the National Academy of Sciences.

[11]  Thad Starner,et al.  Tactile taps teach rhythmic text entry: passive haptic learning of morse code , 2016, SEMWEB.

[12]  Lori L Holt,et al.  Learning to use an artificial visual cue in speech identification. , 2010, The Journal of the Acoustical Society of America.

[13]  Ali Israr,et al.  A Phonemic-Based Tactile Display for Speech Communication , 2019, IEEE Transactions on Haptics.

[14]  Lynette A. Jones,et al.  Application of Psychophysical Techniques to Haptic Research , 2013, IEEE Transactions on Haptics.

[15]  Aaron R. Seitz,et al.  Nonnative implicit phonetic training in multiple reverberant environments , 2019, Attention, perception & psychophysics.

[16]  Yang Jiao,et al.  Acquisition of 500 English Words through a TActile Phonemic Sleeve (TAPS) , 2020, IEEE Transactions on Haptics.

[17]  Thad Starner,et al.  Passive haptic learning of Braille typing , 2014, SEMWEB.

[18]  Aaron R. Seitz,et al.  Implicit training of nonnative speech stimuli. , 2012, Journal of experimental psychology. General.

[19]  Natasha Z. Kirkham,et al.  Incidental learning in a multisensory environment across childhood , 2017, Developmental science.

[20]  Lynette A. Jones,et al.  Tactile and Haptic Illusions , 2011, IEEE Transactions on Haptics.

[21]  Daniel L. Schacter,et al.  Specificity of priming: a cognitive neuroscience perspective , 2004, Nature Reviews Neuroscience.

[22]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[23]  Aaron R. Seitz,et al.  Psychophysics: Is subliminal learning really passive? , 2003, Nature.

[24]  Ellen Yi-Luen Do,et al.  Mobile music touch: mobile tactile stimulation for passive learning , 2010, CHI.

[25]  Lori L. Holt,et al.  Learning Foreign Sounds in an Alien World: Videogame Training Improves Non-Native Speech Categorization , 2011, Cogn. Sci..

[26]  L. Holt,et al.  Incidental categorization of spectrally complex non-invariant auditory stimuli in a computer game task. , 2005, The Journal of the Acoustical Society of America.