Coding Tactile Symbols for Phonemic Communication

We present a study to examine one's learning and processing capacity of broadband tactile information, such as that derived from speech. In Study 1, we tested a user's capability to recognize tactile locations and movements on the forearm in the presence of masking stimuli and determined 9 distinguishable tactile symbols. We associated these symbols to 9 phonemes using two approaches, random and articulation associations. Study 2 showed that novice participants can learn both associations. However, performance for retention, construction of words and knowledge transfer to recognize unlearned words was better with articulation association. In study 3, we trained novel participants to directly recognize words before learning phonemes. Our results show that novel users can retain and generalize the knowledge to recognize new words faster when they were directly train on words. Finally, Study 4 examined optimal presentation rate for the tactile symbols without compromising learning and recognition rate.

[1]  Eduardo E. Veas,et al.  Skin Reading: encoding text in a 6-channel haptic display , 2016, SEMWEB.

[2]  Hideto Ide,et al.  A tactile display using phantom sensation with apparent movement together , 2008 .

[3]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[4]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[5]  V Bochkarev Vladimir,et al.  The average word length dynamics as an indicator of cultural changes in society , 2015 .

[6]  P L Brooks,et al.  Acquisition of a 250-word vocabulary through a tactile vocoder. , 1985, The Journal of the Acoustical Society of America.

[7]  J. C. Bliss,et al.  A direct translation reading aid for the blind , 1966 .

[8]  Ali Israr,et al.  Controller design and consonantal contrast coding using a multi-finger tactual display. , 2009, The Journal of the Acoustical Society of America.

[9]  Lynette A Jones,et al.  Vibrotactile Pattern Recognition on the Arm and Back , 2009, Perception.

[10]  Gary Jones,et al.  Why Chunking Should be Considered as an Explanation for Developmental Change before Short-Term Memory Capacity and Processing Speed , 2012, Front. Psychology.

[11]  D. Keltner,et al.  The communication of emotion via touch. , 2009, Emotion.

[12]  Charles Spence,et al.  Taking someone else’s spatial perspective: Natural stance or effortful decentring? , 2016, Cognition.

[13]  D. S. Alles,et al.  Information Transmission by Phantom Sensations , 1970 .

[14]  Charles Spence,et al.  The skin as a medium for sensory substitution. , 2014, Multisensory research.

[15]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[16]  Li-Wei Chan,et al.  EdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display , 2016, UIST.

[17]  Scott David Novich.  Sound-to-Touch Sensory Substitution and Beyond , 2015 .

[18]  Catherine V Palmer,et al.  Efficacy of individual auditory training in adults: a systematic review of the evidence. , 2005, Journal of the American Academy of Audiology.

[19]  Vladimir V. Bochkarev,et al.  Average word length dynamics as indicator of cultural changes in society , 2012, ArXiv.

[20]  Keren Rice,et al.  The Blackwell Companion to Phonology , 2011 .

[21]  Ali Israr,et al.  Intermanual apparent tactile motion on handheld tablets , 2015, 2015 IEEE World Haptics Conference (WHC).

[22]  Karon E. MacLean,et al.  Haptic phonemes: basic building blocks of haptic communication , 2006, ICMI '06.

[23]  Hong Z. Tan,et al.  Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities , 2010, IEEE Transactions on Haptics.

[24]  F. A. Geldard.  Adventures in tactile literacy. , 1957 .

[25]  Seung-Chan Kim,et al.  Surround haptics: tactile feedback for immersive gaming experiences , 2012, CHI Extended Abstracts.

[26]  Karon E. MacLean,et al.  Designing Large Sets of Haptic Icons with Rhythm , 2008, EuroHaptics.

[27]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[28]  David Eagleman.  Plenary talks: A vibrotactile sensory substitution device for the deaf and profoundly hearing impaired , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[29]  R. Klatzky,et al.  Tactile roughness perception with a rigid link interposed between skin and surface , 1999, Perception & psychophysics.

[30]  C M Reed,et al.  Analytic study of the Tadoma method: identification of consonants and vowels by an experienced Tadoma user. , 1982, Journal of speech and hearing research.

[31]  Charles Spence,et al.  Compatibility effects between sound frequency and tactile elevation , 2009, Neuroreport.

[32]  E. H. Weber,et al.  De Subtilitate Tactus , 2018, E.H. Weber on the Tactile Senses.

[33]  John G. Seamon,et al.  Depth of processing in recall and recognition memory: Differential effects of stimulus meaningfulness and serial position. , 1976 .

[34]  Eduardo E. Veas,et al.  Personalising vibrotactile displays through perceptual sensitivity adjustment , 2017, SEMWEB.

[35]  Gi-Hun Yang,et al.  Sensory Saltation and Phantom Sensation for Vibrotactile Display of Spatial and Directional Information , 2012, PRESENCE: Teleoperators and Virtual Environments.

[36]  D. Keltner,et al.  Touch communicates distinct emotions. , 2006, Emotion.

[37]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[38]  J. Craig,et al.  Texture perception through direct and indirect touch: An analysis of perceptual space for tactile textures in two modes of exploration , 2007, Somatosensory & motor research.

[39]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[40]  T. S. Hyde,et al.  Differential effects of incidental tasks on the organization of recall of a list of highly associated words. , 1969 .

[41]  David M. Eagleman,et al.  Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput , 2015, Experimental Brain Research.

[42]  Ali Israr,et al.  Discrimination of consonant articulation location by tactile stimulation of the forearm , 2010, 2010 IEEE Haptics Symposium.

[43]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[44]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .