From Pulse Trains to "Coloring with Vibrations": Motion Mappings for Mid-Air Haptic Textures

Can we experience haptic textures in mid-air? Typically, the experience of texture is caused by vibration of the fingertip as it moves over the surface of an object. This object's surface also guides the finger's movement, creating an implicit motion-to-vibration mapping. If we wish to simulate a texture in mid-air, such guidance does not exist, making the choice of motion-to-vibration mapping non-obvious. We evaluate the experience of moving a pointer with four different motion-to vibration mappings in an interview study. We found that some mappings lead to a perception shift, transforming the experience. When this occurs, the pointer is no longer perceived as vibrating, interactions become more pleasurable, and users have an increased experience of agency and control. We discuss how to leverage this in the design of haptic interfaces.

[1]  Claire Petitmengin,et al.  Describing one’s subjective experience in the second person: An interview method for the science of consciousness , 2006 .

[2]  Ivan Poupyrev,et al.  Haptic feedback for pen computing: directions and strategies , 2004, CHI EA '04.

[3]  Johan Kildal,et al.  3D-press: haptic illusion of compliance when pressing on a rigid surface , 2010, ICMI-MLMI '10.

[4]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[5]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.

[6]  Anna Vallgårda,et al.  The Hedonic Haptics Player: A Wearable Device to Experience Vibrotactile Compositions , 2017, Conference on Designing Interactive Systems.

[7]  V. Hayward,et al.  Design and analysis of a recoil-type vibrotactile transducer. , 2010, The Journal of the Acoustical Society of America.

[8]  Matt Jones,et al.  Sweep-Shake: finding digital resources in physical environments , 2009, Mobile HCI.

[9]  Heather Culbertson,et al.  Importance of Matching Physical Friction, Hardness, and Texture in Creating Realistic Haptic Virtual Surfaces , 2017, IEEE Transactions on Haptics.

[10]  L. Brown Eggs-ploring the influence of material properties on haptic experience , 2007 .

[11]  Daniel Pargman,et al.  Five perspectives on computer game history , 2007, INTR.

[12]  R. H. Gault TOUCH AS A SUBSTITUTE FOR HEARING IN THE INTERPRETATION AND CONTROL OF SPEECH , 1926 .

[13]  M. Hollins,et al.  Pacinian representations of fine surface texture , 2005, Perception & psychophysics.

[14]  Vuokko Lantz,et al.  Perception of dynamic audiotactile feedback to gesture input , 2008, ICMI '08.

[15]  Heather Culbertson,et al.  Generating haptic texture models from unconstrained tool-surface interactions , 2013, 2013 World Haptics Conference (WHC).

[16]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[17]  Ali Israr,et al.  Stereo Haptics: Designing Haptic Interactions using Audio Tools , 2016, Tangible and Embedded Interaction.

[18]  Allison M. Okamura,et al.  Fingertip Tactile Devices for Virtual Object Manipulation and Exploration , 2017, CHI.

[19]  Ali Israr,et al.  FeelCraft: crafting tactile experiences for media using a feel effect library , 2014, UIST.

[20]  Martin Halvey,et al.  Some like it hot: thermal feedback for mobile devices , 2011, CHI.

[21]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[22]  Anindya Sinha,et al.  Some like it hot . . . , 1992, Nature.

[23]  Sriram Subramanian,et al.  Haptic feedback in remote pointing , 2009, CHI Extended Abstracts.

[24]  Allison M. Okamura,et al.  Haptic Orientation Guidance Using Two Parallel Double-Gimbal Control Moment Gyroscopes , 2018, IEEE Transactions on Haptics.

[25]  Tony Morelli,et al.  Spatial gestures using a tactile-proprioceptive display , 2012, Tangible and Embedded Interaction.

[26]  Eve E. Hoggan,et al.  An Exploration of Mobile Shape-Changing Textures , 2017, TEI.

[27]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[28]  Dag Svanæs,et al.  Interaction design for and with the lived body: Some implications of merleau-ponty's phenomenology , 2013, TCHI.

[29]  John Cohen The World of Touch , 1952, Nature.

[30]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[31]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[32]  Paul Strohmeier,et al.  Coupling Motion and Perception in Body Based UI , 2017, TEI.

[33]  J. Kevin O'Regan,et al.  Exploring the subjective experience of the “rubber hand” illusion , 2013, Front. Hum. Neurosci..

[34]  Manfred Tscheligi,et al.  TorqueScreen: Actuated Flywheels for Ungrounded Kinaesthetic Feedback in Handheld Devices , 2015, TEI.

[35]  Allison M. Okamura,et al.  WAVES: A Wearable Asymmetric Vibration Excitation System for Presenting Three-Dimensional Translation and Rotation Cues , 2017, CHI.

[36]  Vuokko Lantz,et al.  Dynamic audiotactile feedback in gesture interaction , 2008, Mobile HCI.

[37]  Ali Israr,et al.  Intermanual apparent tactile motion on handheld tablets , 2015, 2015 IEEE World Haptics Conference (WHC).

[38]  J. Frisby,et al.  Illusory Contours: Curious Cases of Simultaneous Brightness Contrast? , 1975 .

[39]  Claire Petitmengin-Peugeot The Intuitive Experience , 2007 .

[40]  Paul Strohmeier Exploring Bodies, Mediation and Points of View using a Robotic Avatar , 2016, Tangible and Embedded Interaction.

[41]  Jan O. Borchers,et al.  MudPad: tactile feedback and haptic texture overlay for touch surfaces , 2010, ITS '10.

[42]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[43]  Vincent Lévesque,et al.  ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input , 2016, TEI.

[44]  Heather Culbertson,et al.  Ungrounded Haptic Augmented Reality System for Displaying Roughness and Friction , 2017, IEEE/ASME Transactions on Mechatronics.

[45]  P. Verbeek,et al.  What things do , 2005 .

[46]  Kasper Hornbæk,et al.  Generating Haptic Textures with a Vibrotactile Actuator , 2017, CHI.

[47]  V. Hayward,et al.  An Experiment on Length Perception with a Virtual Rolling Stone , 2006 .

[48]  William Harwin,et al.  Quantification of the effects of haptic feedback during motor skills tasks in a simulated environment , 2000 .