Seeing Through Touch: The Role of Haptic Information in Visualization

This chapter presents evidence for the development of visualizationbreak through touch when in circumstances where no visual information is provided. Results reported here show that local touch is translated into gestalt whole visualized patterns. It further shows that haptics, perception through touch, has semantics and that specific force patterns that constitute haptic interactions act as elements of information that are translated into visual images. It is shown that regions in the occipital brain, especially the Lateral Occipital Tactile-Visual Area, are activated when subjects attempt to recognize a shape haptically. Visualization of haptic patterns provides holistic gestalt views based on local haptic sensory cues. Haptic information contributes the micro details to visualization while the macro details are contributed by the human-visual system. It is further concluded that these findings about the processes of touch – visualization have major implications for design of cognitive technology with the intention of improving learning. A combination of touch and visual cues is advantageous to learning, providing more than each for the construction of a meaningful image of the world.

[1]  Stephen Klassen The Science Thought Experiment: How Might it be Used Profitably in the Classroom? , 2006 .

[2]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[3]  M. Reiner,et al.  On the Limitations of Thought Experiments in Physics and the Consequences for Physics Education , 2003 .

[4]  Hiroo Iwata,et al.  Haptic interfaces , 2002 .

[5]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[6]  Miriam Reiner,et al.  Epistemological resources for thought experimentation in science learning , 2000 .

[7]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[8]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[9]  Miriam Reiner,et al.  Thought experiments in science education: potential and current realization , 2000 .

[10]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[11]  Miriam Reiner,et al.  The Context of Thought Experiments in Physics Learning , 2006 .

[12]  F. L. Engel,et al.  Improved efficiency through I- and E-feedback: a trackball with contextual force feedback , 1994, Int. J. Hum. Comput. Stud..

[13]  Miriam Reiner,et al.  The symbiotic roles of empirical experimentation and thought experimentation in the learning of physics , 2004 .

[14]  T. Hendler,et al.  Visuo-haptic object-related activation in the ventral visual pathway , 2001, Nature Neuroscience.

[15]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.

[16]  Susan J. Lederman,et al.  Perceiving Surface Roughness via a Rigid Probe: Effects of Exploration Speed and Mode of Touch , 1999 .