2bit-TactileHand: Evaluating Tactons for On-Body Vibrotactile Displays on the Hand and Wrist

Visual interfaces can provide a great density of information. However, the required focused visual attention results in a high cognitive effort. This cognitive load significantly increases when multiple tasks are performed that also require visual attention. In this paper, we evaluate the perceptual abilities of 2bit tactons on the wrist and the hand as a type of complementary feedback. Based on our evaluation, 2bit tactons are reasonably high perceivable (≈ 92%) at the hand distributed among several fingers. Additionally, the data concluded that vibrotactile feedback on hand is significantly more accurate than the wrist, which coincides with the subjects' preference. TactileHand's feasibility was demonstrated in three pilot studies, encoding ambient, explicit and implicit information into 2bit tactons in different scenarios.

[1]  Suranga Nanayakkara,et al.  Supporting Rhythm Activities of Deaf Children using Music-Sensory-Substitution Systems , 2018, CHI.

[2]  John H. Wright,et al.  Information-Processing Channels in the Tactile Sensory System: A Psychophysical and Physiological Analysis , 2008 .

[3]  Alex Olwal,et al.  proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers , 2016, UIST.

[4]  Stephen A. Brewster,et al.  Mobile Multi-actuator Tactile Displays , 2007, HAID.

[5]  R. H. Gault.  TOUCH AS A SUBSTITUTE FOR HEARING IN THE INTERPRETATION AND CONTROL OF SPEECH , 1926 .

[6]  Suranga Nanayakkara,et al.  The haptic chair as a speech training aid for the deaf , 2012, OZCHI.

[7]  Suranga Nanayakkara,et al.  An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair , 2009, CHI.

[8]  Henry L. Lew,et al.  Stepping over obstacles to improve walking in individuals with poststroke hemiplegia. , 2004, Journal of rehabilitation research and development.

[9]  Morten Fjeld,et al.  OmniVib: Towards Cross-body Spatiotemporal Vibrotactile Notifications for Mobile Phones , 2015, CHI.

[10]  Eduardo E. Veas,et al.  Skin Reading: encoding text in a 6-channel haptic display , 2016, SEMWEB.

[11]  Lynette A. Jones,et al.  Evaluating Vibrotactile Dimensions for the Design of Tactons , 2014, IEEE Transactions on Haptics.

[12]  J.B.F. van Erp,et al.  Application of tactile displays in sports : where to, how and when to move , 2006 .

[13]  Norbert A. Streitz,et al.  Roomware: Toward the Next Generation of Human- Computer Interaction Based on an Integrated Design of Real and Virtual Worlds , 2001 .

[14]  R. A. Reeder.  Detecting knee hyperextension using goniometric inclinometer sensing with vibrotactile feedback , 1998, IMTC/98 Conference Proceedings. IEEE Instrumentation and Measurement Technology Conference. Where Instrumentation is Going (Cat. No.98CH36222).

[15]  Antti Oulasvirta,et al.  Dynamic tactile guidance for visual search tasks , 2012, UIST '12.

[16]  Brendan Iribe.  Oculus Rift를 이용한 체감형 게임 구현 , 2014 .

[17]  Daniel Chen,et al.  Weak at the Knees: Wearable Haptic Feedback Device for Real-Time Gait Retraining for Slowing Knee Osteoarthritis , 2017 .

[18]  M Akamatsu,et al.  Please Scroll down for Article Ergonomics a Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task Using a Mouse-type Device , 2022 .

[19]  Margarita Anastassova,et al.  What's around me? Multi-actuator haptic feedback on the wrist , 2013, 2013 World Haptics Conference (WHC).

[20]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[21]  Pierre E. Dupont,et al.  Haptic identification of remote environment properties , 1998, Other Conferences.

[22]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[23]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[24]  John Zelek,et al.  Seeing by touch (haptics) for wayfinding , 2005 .

[25]  Thomas Hulin,et al.  Evaluation of a vibrotactile feedback device for spatial guidance , 2011, 2011 IEEE World Haptics Conference.

[26]  Stephen A. Brewster,et al.  New parameters for tacton design , 2007, CHI Extended Abstracts.

[27]  Suranga Nanayakkara,et al.  MuSS-bits: sensor-display blocks for deaf people to explore musical sounds , 2016, OZCHI.

[28]  Rainer Brück,et al.  AUDIS wear: A smartwatch based assistive device for ubiquitous awareness of environmental sounds , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  Deborah I. Fels,et al.  The emoti-chair: an interactive tactile music exhibit , 2010, CHI Extended Abstracts.

[30]  E. Guglielmelli,et al.  Forearm orientation guidance with a vibrotactile feedback bracelet: On the directionality of tactile motor communication , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[31]  M. Sile O'Modhrain,et al.  Cutaneous Grooves: Composing for the Sense of Touch , 2002 .

[32]  R. T. Verrillo,et al.  Vibration Sensation in Humans , 1992 .

[33]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[34]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[35]  Sebastian Günther,et al.  TactileGlove: Assistive Spatial Guidance in 3D Space through Vibrotactile Navigation , 2018, PETRA.

[36]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[37]  J H Kirman.  Tactile perception of computer-derived formant patterns from voiced speech. , 1974, The Journal of the Acoustical Society of America.

[38]  Suranga Nanayakkara,et al.  GymSoles: Improving Squats and Dead-Lifts by Visualizing the User's Center of Pressure , 2019, CHI.

[39]  S. H. Kalisvaart,et al.  System for Monitoring and Coaching of Sportsmen , 2004, EUSAI.

[40]  C. Rosado,et al.  Translational haptic feedback for post-stroke rehabilitation , 2007, 2007 IEEE 33rd Annual Northeast Bioengineering Conference.

[41]  Anil K. Raj,et al.  Vibrotactile Displays for Improving Spatial Awareness , 2000 .

[42]  Jan O. Borchers,et al.  VibroVision: An On-Body Tactile Image Guide for the Blind , 2016, CHI Extended Abstracts.

[43]  Denys J. C. Matthies.  Reflexive interaction - extending peripheral interaction by augmenting humans , 2018 .

[44]  Bodo Urban,et al.  Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation , 2015, iWOAR.

[45]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[46]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[47]  Lynette A. Jones,et al.  Identification of vibrotactile patterns: building blocks for tactons , 2013, 2013 World Haptics Conference (WHC).

[48]  Nikolaos G. Bourbakis,et al.  A 2D Vibration Array as an Assistive Device for Visually Impaired , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[49]  Rezaul K. Begg,et al.  Foot Plantar Pressure Measurement System: A Review , 2012, Sensors.

[50]  Thorsten A. Kern,et al.  Engineering Haptic Devices: A Beginner's Guide for Engineers , 2009 .

[51]  R. Escamilla.  Knee biomechanics of the dynamic squat exercise. , 2001, Medicine and science in sports and exercise.

[52]  J.B.F. van Erp,et al.  Vibro-Tactile Information Presentation in Automobiles , 2001 .

[53]  Gi-Hun Yang,et al.  T-mobile: Vibrotactile display pad with spatial and directional information for hand-held device , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Walter D. Potter,et al.  Vibrotactile Glove guidance for semi-autonomous wheelchair operations , 2008, ACM-SE 46.