Stylo and handifact: modulating haptic perception through visualizations for posture training in augmented reality

Stylo-Handifact is a novel spatial user interface consisting of a haptic device (i. e., Stylo) attached to the forearm and a visualization of a virtual hand (i. e., Handifact), which in combination provide visuo-haptic feedback for posture training applications. In this paper we evaluate the mutual effects of Handifact and Stylo on visuo-haptic sensations in a psychophysical experiment. The results show that a visual stimulus can modulate the perceived strength of a haptic stimulus by more than 5%. A wrist docking task indicates that Stylo-Handifact results in improved task completion time as compared to a state-of-the-art technique.

[1]  Susannah Hollister.  Dance Dance Revolution , 2012 .

[2]  Pedro Lopes,et al.  Muscle-plotter: An Interactive System based on Electrical Muscle Stimulation that Produces Spatial Output , 2016, UIST.

[3]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[4]  Jonathan Tong,et al.  Tactile length contraction as Bayesian inference. , 2016, Journal of neurophysiology.

[5]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[6]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[7]  G K Humphrey,et al.  An Examination of the Effects of Axis Foreshortening, Monocular Depth Cues, and Visual Field on Object Identification , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  Jianwei Zhang,et al.  An efficient hybridization of Genetic Algorithms and Particle Swarm Optimization for inverse kinematics , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Noriaki Kanayama,et al.  “Cutaneous Rabbit” Hops Toward a Light: Unimodal and Cross-Modal Causality on the Skin , 2012, Front. Psychology.

[10]  M. Nardini,et al.  Integration of audio-visual information for spatial decisions in children and adults. , 2016, Developmental science.

[11]  Ellen Poliakoff,et al.  Tactile spatial acuity varies with site and axis in the human upper limb , 2008, Neuroscience Letters.

[12]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[13]  Kosuke Sato,et al.  SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality , 2015, IEEE Transactions on Visualization and Computer Graphics.

[14]  Erin Piateski,et al.  Vibrotactile pattern recognition on the arm and torso , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[15]  Taku Komura,et al.  A Virtual Reality Dance Training System Using Motion Capture Technology , 2011, IEEE Transactions on Learning Technologies.

[16]  Simon J. Julier,et al.  Presence and discernability in conventional and non-photorealistic immersive augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[17]  Giuseppe di Pellegrino,et al.  Neuropsychological Evidence of an Integrated Visuotactile Representation of Peripersonal Space in Humans , 1998, Journal of Cognitive Neuroscience.

[18]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[19]  Janet van der Linden,et al.  Towards a real-time system for teaching novices correct violin bowing technique , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[20]  Alexandre Pouget,et al.  Bayesian multisensory integration and cross-modal spatial links , 2004, Journal of Physiology-Paris.

[21]  William R. Provancher,et al.  Fingerpad Skin Stretch Increases the Perception of Virtual Friction , 2009, IEEE Transactions on Haptics.

[22]  Frank Vetere,et al.  Onebody: Remote Posture Guidance System using First Person View in Virtual Environment , 2016, NordiCHI.

[23]  Artur Arsenio,et al.  Sleeve Sensing Technologies and Haptic Feedback Patterns for Posture Sensing and Correction , 2016, IUI Companion.

[24]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[25]  C. Hong.  Dance Dance Revolution , 2007 .

[26]  Aaron R. Seitz,et al.  Learning what to expect , 2013 .

[27]  Allison M. Okamura,et al.  Sensory augmentation of stiffness using fingerpad skin stretch , 2013, 2013 World Haptics Conference (WHC).

[28]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[29]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[30]  Pedro Lopes,et al.  Proprioceptive Interaction , 2015, CHI.

[31]  Ali Kanso,et al.  Cross-Modal Associations between Color and Haptics , 2015, Attention, Perception, & Psychophysics.

[32]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[33]  Aaron R. Seitz,et al.  Learning what to expect (in visual perception) , 2013, Front. Hum. Neurosci..

[34]  Stephen Silverman,et al.  Teacher feedback and achievement in physical education: Interaction with student practice , 1992 .

[35]  Xiaoming Chen,et al.  Immersive and collaborative Taichi motion learning in various VR environments , 2017, 2017 IEEE Virtual Reality (VR).

[36]  Pedro Lopes,et al.  Affordance++: Allowing Objects to Communicate Dynamic Use , 2015, CHI.

[37]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[38]  Henry Been-Lirn Duh,et al.  “Left Arm Up!” Interactive Yoga training in virtual environment , 2011, 2011 IEEE Virtual Reality Conference.