A Physics-Based Vibrotactile Feedback Library for Collision Events

We present PhysVib: a software solution on the mobile platform extending an open-source physics engine in a multi-rate rendering architecture for automatic vibrotactile feedback upon collision events. PhysVib runs concurrently with a physics engine at a low update rate and generates vibrotactile feedback commands at a high update rate based on the simulation results of the physics engine using an exponentially-decaying sinusoidal model. We demonstrate through a user study that this vibration model is more appropriate to our purpose in terms of perceptual quality than more complex models based on sound synthesis. We also evaluated the perceptual performance of PhysVib by comparing eight vibrotactile rendering methods. Experimental results suggested that PhysVib enables more realistic vibrotactile feedback than the other methods as to perceived similarity to the visual events. PhysVib is an effective solution for providing physically plausible vibrotactile responses while reducing application development time to great extent.

[1]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[2]  Bohyung Han,et al.  Motion Effects Synthesis for 4D Films , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  Ali Israr,et al.  Feel effects: enriching storytelling with haptic feedback , 2014 .

[4]  Karon E. MacLean,et al.  The Role of Prototyping Tools for Haptic Behavior Design , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[5]  Margarita Anastassova,et al.  TactiPEd: Easy Prototyping of Tactile Patterns , 2013, INTERACT.

[6]  Matthias Harders,et al.  Rendering Virtual Tumors in Real Tissue Mock-Ups Using Haptic Augmented Reality , 2012, IEEE Transactions on Haptics.

[7]  Seungmoon Choi,et al.  Evaluation of vibrotactile pattern design using vibrotactile score , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[8]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[9]  Seungmoon Choi,et al.  Consonance of Vibrotactile Chords , 2014, IEEE Transactions on Haptics.

[10]  Karon E. MacLean,et al.  Foundations of Transparency in Tactile Information Design , 2008, IEEE Transactions on Haptics.

[11]  Federico Avanzini,et al.  Integrating physically based sound models in a multimodal rendering architecture , 2006, Comput. Animat. Virtual Worlds.

[12]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[13]  Ali Israr,et al.  FeelCraft: crafting tactile experiences for media using a feel effect library , 2014, UIST.

[14]  Seungmoon Choi,et al.  Real-Time Dual-Band Haptic Music Player for Mobile Devices , 2013, IEEE Transactions on Haptics.

[15]  Kup-Sze Choi,et al.  Integrating PhysX and OpenHaptics: Efficient force feedback generation using physics engine and haptic devices , 2009, 2009 Joint Conferences on Pervasive Computing (JCPC).

[16]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[17]  Seungmoon Choi,et al.  Real-time perception-level translation from audio signals to vibrotactile effects , 2013, CHI.

[18]  Anatole Lécuyer,et al.  Using an event-based approach to improve the multimodal rendering of 6DOF virtual contact , 2007, VRST '07.

[19]  Seungmoon Choi,et al.  Demonstration-based vibrotactile pattern authoring , 2013, TEI '13.

[20]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[21]  Seungmoon Choi,et al.  Vibrotactile score: A score metaphor for designing vibrotactile patterns , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[22]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[23]  Davide Rocchesso,et al.  MODELING COLLISION SOUNDS: NON-LINEAR CONTACT FORCE , 2001 .

[24]  Angela Chang,et al.  Audio-haptic feedback in mobile phones , 2005, CHI Extended Abstracts.

[25]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  Seungmoon Choi,et al.  posVibEditor: Graphical authoring tool of vibrotactile patterns , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[27]  J. Liu,et al.  Hearing how you touch: Real-time synthesis of contact sounds for multisensory interaction , 2008, 2008 Conference on Human System Interactions.

[28]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[29]  Michitaka Hirose,et al.  Haptic Interface Using Estimatio of Box Contents Metaphor , 2003, ICAT.

[30]  Sungkil Lee,et al.  Saliency-Driven Real-Time Video-to-Tactile Translation , 2014, IEEE Transactions on Haptics.

[31]  Colin Swindells,et al.  Medium fidelity rapid prototyping of vibrotactile haptic, audio and video effects , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[32]  Eve E. Hoggan,et al.  Playing with Tactile Feedback Latency in Touchscreen Interaction: Two Approaches , 2011, INTERACT.

[33]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[34]  Sunghoon Yim,et al.  Data-Driven Haptic Modeling and Rendering of Viscoelastic and Frictional Responses of Deformable Objects , 2016, IEEE Transactions on Haptics.

[35]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[36]  Hong Z. Tan,et al.  A Frequency-Domain Analysis of Haptic Gratings , 2010, IEEE Transactions on Haptics.

[37]  Abderrahmane Kheddar,et al.  Fast Continuous Collision Detection between Rigid Bodies , 2002, Comput. Graph. Forum.

[38]  Allison M. Okamura,et al.  Reality-based models for vibration feedback in virtual environments , 2001 .

[39]  Vincent Hayward,et al.  Multirate haptic simulation achieved by coupling finite element meshes through Norton equivalents , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[40]  Seungmoon Choi,et al.  Tactile effect design and evaluation for virtual buttons on a mobile device touchscreen , 2011, Mobile HCI.

[41]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[42]  Dinesh K. Pai,et al.  The AHI: an audio and haptic interface for contact interactions , 2000, UIST '00.

[43]  Dinesh K. Pai,et al.  FoleyAutomatic: physically-based sound effects for interactive simulation and animation , 2001, SIGGRAPH.

[44]  Karon E. MacLean,et al.  Perceptual Design of Haptic Icons , 2003 .

[45]  Seungmoon Choi,et al.  Improved Haptic Music Player with Auditory Saliency Estimation , 2014, EuroHaptics.