Neuro-cognitively inspired haptic user interfaces

Haptic systems and devices are a recent addition to multimodal systems. These devices have widespread applications such as surgical simulations, medical and procedural training, scientific visualizations, assistive and rehabilitative devices for individuals who have physical or neurological impediments and assistive devices for individuals who are blind. While the potential of haptics in natural human machine interaction is undisputable, the realization of such means is still a long way ahead. There are considerable research challenges to development of natural haptic interfaces. The study of human tactile abilities is a recent endeavor and many of the available systems still do not incorporate the domain knowledge of psychophysics, biomechanics and neurological elements of haptic perception. Development of smart and effective haptic interfaces and devices requires extensive studies that link perceptual phenomena with measurable parameters and incorporation of such domain knowledge in the engineering of haptic interfaces. This paper presents design, development and usability testing of a neuro-cognitively inspired haptic user interface for individuals who are blind. The proposed system design is inspired by neuro-cognitive basis of haptic perception and incorporates the computational aspects and requirements of multimodal information processing system. Usability testing of the system suggests that a biologically inspired haptic user interfaces may form a powerful paradigm for haptic user interface design.

[1]  Sethuraman Panchanathan,et al.  Modeling context in haptic perception, rendering, and visualization , 2006, TOMCCAP.

[2]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[3]  K E Barner,et al.  Design of a haptic data visualization system for people with visual impairments. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[5]  Karin Coninx,et al.  Multisensory interaction metaphors with haptics and proprioception in virtual environments , 2004, NordiCHI '04.

[6]  Yvette Hatwell,et al.  Motor and Cognitive Functions of the Hand in Infancy and Childhood , 1987 .

[7]  H L Pick,et al.  A developmental investigation of visual and haptic preferences for shape and texture. , 1969, Monographs of the Society for Research in Child Development.

[8]  J. DiCarlo,et al.  Structure of Receptive Fields in Area 3b of Primary Somatosensory Cortex in the Alert Monkey , 1998, The Journal of Neuroscience.

[9]  D. Tzovaras,et al.  Design and implementation of haptic virtual environments for the training of the visually impaired , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  R Schellingerhout,et al.  Texture information in tactual space perception. , 1998, Acta psychologica.

[11]  G. Révész,et al.  Psychology and art of the blind , 1950 .

[12]  R. Klatzky,et al.  Action for Perception: Manual Exploratory Movements for Haptically Processing Objects and Their Features , 1996 .

[13]  Kanav Kahol,et al.  Haptic User Interfaces : Design , testing and evaluation of haptic cueing systems to convey shape , material and texture information , 2005 .

[14]  M. Goldberg,et al.  Formalizing cognitive and motor strategy of haptic exploratory movements of individuals who are blind , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[15]  S. Millar.  Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children , 1994 .

[16]  Donald Homa,et al.  Concepts and Transformational Knowledge , 1999, Cognitive Psychology.

[17]  A. Streri,et al.  Touching for knowing : cognitive psychology of haptic manual perception , 2003 .

[18]  Susanna Millar.  Understanding and representing space , 1994 .

[19]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[20]  Arlette Streri,et al.  Tactile discrimination of shape and intermodal transfer in 2‐ to 3‐month‐old infants , 1987 .

[21]  C E Chapman,et al.  Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. , 1994, Canadian journal of physiology and pharmacology.

[22]  S. S. Stevens,et al.  The scaling of subjective roughness and smoothness. , 1962, Journal of experimental psychology.

[23]  Masahiro Sakamoto,et al.  Deficits in manipulative behaviors induced by local injections of muscimol in the first somatosensory cortex of the conscious monkey , 1985, Brain Research.

[24]  A. Volder,et al.  Brain energy metabolism in early blind subjects: neural activity in the visual cortex , 1997, Brain Research.

[25]  H. Pick,et al.  The effect of texture on tactually perceived length , 1969 .

[26]  K. A. Shomper,et al.  Haptic rendering , 1997, 14th Annual AESS/IEEE Dayton Section Symposium. Synthetic Visualization: Systems and Applications.

[27]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[28]  Roland S. Johansson,et al.  Sensory Control of Dexterous Manipulation in Humans , 1996 .

[29]  I. Gordon,et al.  The haptic perception of curvature , 1982, Perception & psychophysics.

[30]  D. I. Perrett,et al.  Visual and somatosensory processing in the macaque temporal cortex: the role of ‘expectation’ , 2004, Experimental Brain Research.

[31]  J. Paillard.  Brain and space , 1991 .

[32]  J. Flanagan,et al.  Hand and brain : the neurophysiology and psychology of hand movements , 1996 .

[33]  Luciana Porcher Nedel,et al.  Testing the Use of Egocentric Interactive Techniques in Immersive Virtual Environments , 2003, INTERACT.

[34]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.