Optimization-Based Wearable Tactile Rendering

Novel wearable tactile interfaces offer the possibility to simulate tactile interactions with virtual environments directly on our skin. But, unlike kinesthetic interfaces, for which haptic rendering is a well explored problem, they pose new questions about the formulation of the rendering problem. In this work, we propose a formulation of tactile rendering as an optimization problem, which is general for a large family of tactile interfaces. Based on an accurate simulation of contact between a finger model and the virtual environment, we pose tactile rendering as the optimization of the device configuration, such that the contact surface between the device and the actual finger matches as close as possible the contact surface in the virtual environment. We describe the optimization formulation in general terms, and we also demonstrate its implementation on a thimble-like wearable device. We validate the tactile rendering formulation by analyzing its force error, and we show that it outperforms other approaches.

[1]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[2]  William R. Provancher,et al.  Design of a Fingertip-Mounted Tactile Display with Tangential Skin Displacement Feedback , 2010, IEEE Transactions on Haptics.

[3]  Antonio Frisoli,et al.  Design of a SMA actuated 2-DoF tactile device for displaying tangential skin displacement , 2011, 2011 IEEE World Haptics Conference.

[4]  Vincent Hayward,et al.  STReSS: A Practical Tactile Display System with One Millimeter Spatial Resolution and 700 Hz Refresh Rate , 2003 .

[5]  Gi-Hun Yang,et al.  Development of Quantitative Tactile Display Device to Provide Both Pin- Array-Type Tactile Feedback and Thermal Feedback , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[6]  Vincent Hayward,et al.  Trajectory of contact region on the fingerpad gives the illusion of haptic shape , 2005, Experimental Brain Research.

[7]  Antonio Frisoli,et al.  A wearable fingertip haptic device with 3 DoF asymmetric 3-RSR kinematics , 2015, 2015 IEEE World Haptics Conference (WHC).

[8]  Francesco Chinello,et al.  Efficient nonlinear skin simulation for multi-finger tactile rendering , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[9]  Haruhisa Kawasaki,et al.  Perception and Haptic Rendering of Friction Moments , 2011, IEEE Transactions on Haptics.

[10]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[11]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[12]  Tae-Heon Yang,et al.  Development of a miniature pin-array tactile module using elastic and electromagnetic force for mobile devices , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[13]  Nikolaos G. Tsagarakis,et al.  A High Performance Tactile Feedback Display and Its Integration in Teleoperation , 2012, IEEE Transactions on Haptics.

[14]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[15]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[16]  Mark R. Cutkosky,et al.  Contact Location Display for Haptic Perception of Curvature and Object Motion , 2005, Int. J. Robotics Res..

[17]  Hong Z. Tan,et al.  Development of a wearable haptic display for situation awareness in altered-gravity environment: some initial findings , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[18]  Antonio Frisoli,et al.  A Fingertip Haptic Display for Improving Curvature Discrimination , 2008, PRESENCE: Teleoperators and Virtual Environments.

[19]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[20]  Si-bok Yu,et al.  Vibrotactile Display for Driving Safety Information , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[21]  Matteo Bianchi,et al.  A device for mimicking the contact force/contact area relationship of different materials with applications to softness rendering , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Miguel A. Otaduy,et al.  Strain limiting for soft finger contact simulation , 2013, 2013 World Haptics Conference (WHC).

[23]  Miguel A. Otaduy,et al.  Interactive simulation of a deformable hand for haptic rendering , 2011, 2011 IEEE World Haptics Conference.

[24]  Ferdinando Cannella,et al.  Characterization of nonlinear finger pad mechanics for tactile rendering , 2015, 2015 IEEE World Haptics Conference (WHC).

[25]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[26]  Ming C. Lin,et al.  Representations and Algorithms for Force-Feedback Display , 2013, Proceedings of the IEEE.

[27]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[28]  L. W. Tsai,et al.  Robot Analysis: The Mechanics of Serial and Parallel Ma-nipulators , 1999 .

[29]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[30]  John Kenneth Salisbury,et al.  Simulating human fingers: a soft finger proxy model and algorithm , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[31]  Allison M. Okamura,et al.  Sensory substitution using 3-degree-of-freedom tangential and normal skin deformation feedback , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[32]  W. Harwin,et al.  Improved Haptic Rendering for Multi-Finger Manipulation Using Friction Cone based God-Objects , 2002 .

[33]  Francesco Chinello,et al.  Vibrotactile haptic feedback for human-robot interaction in leader-follower tasks , 2012, PETRA '12.

[34]  Francesco Chinello,et al.  Soft finger tactile rendering for wearable haptics , 2015, 2015 IEEE World Haptics Conference (WHC).

[35]  Stephane Cotin,et al.  Constraint-Based Haptic Rendering of Multirate Compliant Mechanisms , 2011, IEEE Transactions on Haptics.

[36]  Xin Zhang,et al.  Configuration-based optimization for six degree-of-freedom haptic rendering for fine manipulation. , 2013, IEEE transactions on haptics.

[37]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[38]  Kouta Minamizawa,et al.  A Wearable Haptic Display to Present the Gravity Sensation - Preliminary Observations and Device Design , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[39]  Matteo Bianchi,et al.  Design and preliminary affective characterization of a novel fabric-based tactile display , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[40]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[41]  Antonio Frisoli,et al.  The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation , 2011, Brain Research Bulletin.

[42]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[43]  Hong Z. Tan,et al.  Haptic Edge Sharpness Perception with a Contact Location Display , 2012, IEEE Transactions on Haptics.

[44]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[45]  M.A. Salada,et al.  Validating a novel approach to rendering fingertip contact sensations , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.