A Novel Interactive Mouse System for Holistic Haptic Display in a Human-Computer Interface

The sense of touch provides humans with the ability to determine the shape and surface properties of objects. Although touch is an important part of daily life for object manipulation and exploration tasks, users are, unfortunately, rarely provided with the opportunity to use their sense of touch while interacting with computers. To rectify this, this article presents a novel haptic mouse system that can be used as a human-computer interface with the capability for holistic haptic feedback, including contact force, surface properties, and thermal feedback. The system is composed of 3 main parts. First, the 5-bar mechanism, which comprises the lowermost part of the mouse's body, has been adapted to realize 2-DOF translational force feedback. This mechanism helps the user to feel the contact force, stiffness, and size of a virtual object while exploring a graphical environment. Second, a small tactile display was developed. It has a planar-distributed pin array, and it can represent microscale shapes with various surfaces, such as gratings, grooves, patterns, shapes of icons, and Braille, thereby providing the user with cutaneous stimuli. Third, because the ability to sense temperature is an important factor in the discrimination of the surface property of an object, thermal feedback is provided to the user. The performance of each part and their combinations has been evaluated, and the system shows a remarkable ability to provide users with tactual information while they simply use the mouse without any additional interfaces.

[1]  Septimiu E. Salcudean,et al.  On the development of a force-feedback mouse and its integration into a graphical user interface , 1994 .

[2]  M. Srinivasan.  Surface deflection of primate fingertip under line load. , 1989, Journal of biomechanics.

[3]  Günther Schmidt,et al.  Display of Holistic Haptic Sensations by Combined Tactile and Kinesthetic Feedback , 2004, Presence: Teleoperators & Virtual Environments.

[4]  Rakesh Gupta,et al.  Experiments Using Multimodal Virtual Environments in Design for Assembly Analysis , 1997, Presence: Teleoperators & Virtual Environments.

[5]  G. Essick,et al.  Factors affecting direction discrimination of moving tactile stimuli , 1998 .

[6]  Vincent Hayward,et al.  Multiple-goal kinematic optimization of a parallel spherical mechanism with actuator redundancy , 1992, IEEE Trans. Robotics Autom..

[7]  Grigore C. Burdea,et al.  A Portable Dextrous Master with Force Feedback , 1992, Presence: Teleoperators & Virtual Environments.

[8]  T. Diller.  Frequency response of human skin in vivo to mechanical stimulation , 2001 .

[9]  Motoyuki Akamatsu,et al.  A multi-modal mouse with tactile and force feedback , 1994, Int. J. Hum. Comput. Stud..

[10]  Dong-Soo Kwon,et al.  Perceptual and biomechanical frequency response of human skin: implication for design of tactile displays , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[11]  Stan S. Swallow,et al.  Sensory Fabric for Ubiquitous Interfaces , 2001, Int. J. Hum. Comput. Interact..

[12]  Hong Z. Tan,et al.  HUMAN FACTORS FOR THE DESIGN OF FORCE-REFLECTING HAPTIC INTERFACES , 1994 .

[13]  Hiroyuki Shinoda,et al.  Selectively Stimulating Skin Receptors for Tactile Display , 1998, IEEE Computer Graphics and Applications.

[14]  Lynette A. Jones,et al.  Material discrimination and thermal perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[15]  Nikolaos G. Tsagarakis,et al.  Mechano thermo and proprioceptor feedback for integrated haptic feedback , 1997, Proceedings of International Conference on Robotics and Automation.

[16]  Lynette A. Jones,et al.  The psychophysics of temperature perception and thermal-interface design , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[17]  Dong-Soo Kwon,et al.  Interactive Mouse Systems Providing Haptic Feedback During the Exploration in Virtual Environment , 2004, ISCIS.

[18]  Darwin G. Caldwell,et al.  Multi-armed dexterous manipulator operation using glove/exoskeleton control and sensory feedback , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[19]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[20]  Motoyuki Akamatsu,et al.  Movement characteristics using a mouse with tactile and force feedback , 1996, Int. J. Hum. Comput. Stud..

[21]  James C Craig,et al.  Identification of scanned and static tactile patterns , 2002, Perception & psychophysics.

[22]  Grigore C. Burdea,et al.  Haptics issues in virtual environments , 2000, Proceedings Computer Graphics International 2000.

[23]  Massimo Bergamasco,et al.  Thermal Feedback in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[24]  Munsang Kim,et al.  Design of a Novel Haptic Mouse System , 2002 .

[25]  Woodrow Barfield,et al.  A Review of Presence and Performance in Virtual Environments , 2000, Int. J. Hum. Comput. Interact..

[26]  A. Fraioli,et al.  Sensation magnitude of vibrotactile stimuli , 1969 .

[27]  S. Lederman.  The perception of surface roughness by active and passive touch , 1981 .

[28]  Dong-Soo Kwon,et al.  A compact planar distributed tactile display and effects of frequency on texture judgment , 2006, Adv. Robotics.

[29]  Shuichi Ino,et al.  A tactile display for presenting quality of materials by changing the temperature of skin surface , 1993, Proceedings of 1993 2nd IEEE International Workshop on Robot and Human Communication.

[30]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[31]  Cristina Botella,et al.  Interfaces That Heal: Coupling Real and Virtual Objects to Treat Spider Phobia , 2003, Int. J. Hum. Comput. Interact..

[32]  Dong-Soo Kwon,et al.  Design of an integrated tactile display system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.