Development of Finger-Mounted High-Density Pin-Array Haptic Display

The presentation of virtual object shapes using a finger-mounted pin-array haptic display is one of the major topics of research in haptics. If this can be realized, the operability of objects and immersive feeling in the virtual space will be improved. For now, previous studies showed that shape recognition performance using such a pin-array display was far inferior from the performance in the real world using a real object. We considered that both the density of contact points and coverage areas are essential to improve the recognition performance. However, the size of the actuator that pushes each pin was a constraint, and the previously developed display could not have a large contact density and coverage area. This study proposes a novel design of a finger-mounted pin-array display that works around the constraint. We adopted a pneumatic drive because the pneumatic actuator, or air cylinder, can be a simple structure and can be arranged in a dense array. Our developed finger-mounted display has a higher contact point density and a larger coverage area than any other previously developed devices. It covered more than 4 times larger area on fingerpad with denser pin arrangements. An experiment to evaluate the recognition performance with the device was conducted. Participants discriminated 10 kinds of 2D patterned alphabet shapes with only haptic information. The result showed participants could recognize the ten kinds of 2D patterned shape with 93.8% accuracy. Though our participants’ task in the experiment was more difficult, the accuracy was better than previous studies. It suggests the effect of the higher density and the larger size of the coverage.

[1]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[2]  Antonio Frisoli,et al.  A Fingertip Haptic Display for Improving Curvature Discrimination , 2008, PRESENCE: Teleoperators and Virtual Environments.

[3]  Y. Lamarre,et al.  Haptic discrimination of object shape in humans: contribution of cutaneous and proprioceptive inputs , 2002, Experimental Brain Research.

[4]  Hiroshi Ishii,et al.  Haptic Edge Display for Mobile Tactile Interaction , 2016, CHI.

[5]  Heather Culbertson,et al.  Wearable Haptic Pneumatic Device for Creating the Illusion of Lateral Motion on the Arm , 2019, 2019 IEEE World Haptics Conference (WHC).

[6]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[7]  R L Klatzky,et al.  Identifying objects by touch: An “expert system” , 1985, Perception & psychophysics.

[8]  Nikolaos G. Tsagarakis,et al.  A portable fingertip tactile feedback array - transmission system reliability and modelling , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[9]  Gi-Hun Yang,et al.  Small and lightweight tactile display(SaLT) and its application , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[11]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[12]  Hiroyuki Kajimoto,et al.  The Whole Hand Haptic Glove Using Numerous Linear Resonant Actuators (III) -Improvement of haptic feedback- , 2015 .

[13]  Sho Sakurai,et al.  Influence of Sparse Contact Point and Finger Penetration in Object on Shape Recognition , 2019, IEEE Transactions on Haptics.

[14]  Allison M. Okamura,et al.  Augmentation Of Stiffness Perception With a 1-Degree-of-Freedom Skin Stretch Device , 2014, IEEE Transactions on Human-Machine Systems.

[15]  Jérôme Szewczyk,et al.  A low-cost highly-portable tactile display based on shape memory alloy micro-actuators , 2005, IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2005..

[16]  Ian Oakley,et al.  Air-Jet Button Effects in AR , 2006, ICAT.

[17]  Jun-Young Lee,et al.  Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display , 2009, IEEE Computer Graphics and Applications.

[18]  Christopher R. Wagner,et al.  A compliant tactile display for teletaction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Antonio Frisoli,et al.  The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation , 2011, Brain Research Bulletin.

[20]  Hiroyuki Kajimoto,et al.  Hapballoon: Wearable Haptic Balloon-Based Feedback Device , 2019, SIGGRAPH ASIA Emerging Technologies.

[21]  Hiroshi Ishii,et al.  Relief: a scalable actuated shape display , 2010, TEI '10.

[22]  Claudio Pacchierotti,et al.  A three DoFs wearable tactile display for exploration and manipulation of virtual objects , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[23]  Amirhossein H. Memar,et al.  PneuSleeve: In-fabric Multimodal Actuation and Sensing in a Soft, Compact, and Expressive Haptic Sleeve , 2020, CHI.

[24]  Peter B. Shull,et al.  HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays , 2019, CHI.

[25]  Hideaki Kuzuoka,et al.  PoCoPo: Handheld Pin-based Shape Display for Haptic Rendering in Virtual Reality , 2020, CHI.

[26]  Allison M. Okamura,et al.  Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback , 2015, IEEE Transactions on Haptics.

[27]  Hideko F. Norman,et al.  The visual and haptic perception of natural object shape , 2004, Perception & Psychophysics.

[28]  S. Saida,et al.  Tactile pattern recognition by graphic display: Importance of 3-D information for haptic perception of familiar objects , 1993, Perception & psychophysics.