Rendering Color Information Using Haptic Feedback

This paper investigates a novel approach to rendering color information from pictures as haptic feedback at the fingers. Our approach uses a 1D haptic rotary display to render the color information to the fingers using sinusoidal textures of different frequency and amplitude. We tested 12 subjects on their ability to associate colors laid out in a spatially irregular pattern with haptic feedback displayed to their fingers, with the numbers of color/haptic stimuli pairs presented increasing in successive trials. The experiment results suggest that subjects are able to comfortably learn and distinguish up to 8 color/haptic stimuli pairs based on this particular mapping; and with some effort, many can distinguish as many as 16 pairs. The results also raise key issues for further investigation in subsequent studies including the role of multimodal inputs like audio along with haptics.

[1]  Susan J. Lederman,et al.  The hand as a perceptual system , 1998 .

[2]  Hiroyuki Shinoda,et al.  Selectively Stimulating Skin Receptors for Tactile Display , 1998, IEEE Computer Graphics and Applications.

[3]  Susan J. Lederman,et al.  Sensing and Displaying Spatially Distributed Fingertip Forces in Haptic Interfaces for Teleoperator and Virtual Environment Systems , 1999, Presence: Teleoperators & Virtual Environments.

[4]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[5]  A. Robin Forrest,et al.  Perceptualisation using a tactile mouse , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[6]  Sara Bly,et al.  Presenting information in sound , 1982, CHI '82.

[7]  R L Klatzky,et al.  Identifying objects by touch: An “expert system” , 1985, Perception & psychophysics.

[8]  Dinesh K. Pai,et al.  Haptic texturing-a stochastic approach , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[9]  Dinesh K. Pai,et al.  Haptic display of visual images , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[10]  Helen Petrie,et al.  Training Blind People in the Use of Graphical User Interfaces , 1994, ICCHP.

[11]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[12]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[13]  Kees van den Doel,et al.  SOUNDVIEW: SENSING COLOR IMAGES BY KINESTHETIC AUDIO , 2003 .

[14]  Kenneth E. Barner,et al.  HAPTIC REPRESENTATION OF SCIENTIFIC DATA FOR VISUALLY IMPAIRED OR BLIND PERSONS , 1996 .

[15]  Helen Petrie,et al.  Tactile-based direct manipulation in GUIs for blind users , 1995, CHI '95.

[16]  R. Johansson,et al.  Tactile sensory coding in the glabrous skin of the human hand , 1983, Trends in Neurosciences.

[17]  Shumin Zhai,et al.  What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint , 1999, INTERACT.

[18]  Eduardo Fernández,et al.  Webvision: The Organization of the Retina and Visual System , 1995 .

[19]  T P Way,et al.  Automatic visual to tactile translation--Part I: Human factors, access methods, and image manipulation. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  R. Klatzky,et al.  Relative availability of surface and object properties during early haptic processing. , 1997, Journal of experimental psychology. Human perception and performance.