Graphical display of tactile sensing data with application in minimally invasive surgery

In this paper, the design of a hardware and software system for graphical representation of tactile sensing data is described in detail. The signal processing is developed using LabView 7 software. The signals from the sensors are processed, and then various tactile properties of the grasped material are extracted. The tactile information includes softness, stress distribution, and lumps. This information is displayed by means of a colour coding method. The technical specifications of the hardware and data acquisition system are described in detail. The system receives signals from the sensors, transforms them into digital signals, and then transmits them to a personal computer. The developed software is also presented, and its capabilities are discussed. Using the designed system, it is possible to determine the softness of objects that come into contact with it. To serve as sensing elements, two piezoelectric films made of polyvinylidene difluoride are incorporated into the sensing assembly, and the combination of the resulting output voltages is related to the object softness. As a practical application, the sensor assembly is integrated with a commercially available endoscopic grasper which has been modified for the purpose of this research.

[1]  M. Shimojo,et al.  A system for simultaneously measuring grasping posture and pressure distribution , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  S. Omata,et al.  Development of Tactile Mapping system for the stiffness characterization of tissue slice using novel tactile sensing technology , 2005 .

[3]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[4]  Javad Dargahi,et al.  A piezoelectric tactile sensor with three sensing elements for robotic, endoscopic and prosthetic applications , 2000 .

[5]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[6]  S. Brady,et al.  The Development and Characterisation of Conducting Polymeric-based Sensing Devices , 2005 .

[7]  Richard M. Satava,et al.  Interactive Technology and the New Paradigm for Healthcare , 1995 .

[8]  J. Dargahi.  An Endoscopic and Robotic Tooth-like Compliance and Roughness Tactile Sensor , 2002 .

[9]  Javad Dargahi,et al.  A novel method in measuring the stiffness of sensed objects with applications for biomedical robotic systems , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[10]  Antonio Bicchi,et al.  A sensor-based minimally invasive surgery tool for detecting tissutal elastic properties(003) 5323219 , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[11]  Javad Dargahi,et al.  Theoretical and experimental analysis of a piezoelectric tactile sensor for use in endoscopic surgery , 2004 .

[12]  Mark H. Lee,et al.  Tactile Sensing: New Directions, New Challenges , 2000, Int. J. Robotics Res..

[13]  J. Dargahi,et al.  An endoscopic force-position sensor grasper with minimum sensors , 2003, Canadian Journal of Electrical and Computer Engineering.

[14]  H.J. Chizeck,et al.  Feedback regulation of hand grasp opening and contact force during stimulation of paralyzed muscle , 1991, IEEE Transactions on Biomedical Engineering.

[15]  Ronald S. Fearing,et al.  A surface micromachined microtactile sensor array , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[16]  J. Dargahi,et al.  Development and three-dimensional modelling of a biological-tissue grasper tool equipped with a tactile sensor , 2005, Canadian Journal of Electrical and Computer Engineering.

[17]  J. R. Hewit,et al.  Tactile sensing technology for minimal access surgery––a review , 2003 .

[18]  H. Rininsland.  Basics of robotics and manipulators in endoscopic surgery. , 1993, Endoscopic surgery and allied technologies.

[19]  Seiji Chonan,et al.  Active haptic sensation for monitoring skin conditions , 2005 .

[20]  Andrzej Odon.  Probe with PVDF Sensor for Energy Measurements of Optical Radiation , 2003 .

[21]  J U Meyer,et al.  Intelligent surgical instrument system ISIS. Concept and preliminary experimental application of components and prototypes. , 1993, Endoscopic surgery and allied technologies.

[22]  Yoseph Bar-Cohen,et al.  Haptic Devices for Virtual Reality, Telepresence, and Human-Assistive Robotics , 2003 .

[23]  I. Shimoyama,et al.  A shear stress sensor for tactile sensing with the piezoresistive cantilever standing in elastic material , 2006 .

[24]  Paolo Dario,et al.  Tactile sensing: Technology and applications , 1991 .

[25]  J Dargahi,et al.  Human tactile perception as a standard for artificial tactile sensing—a review , 2004, The international journal of medical robotics + computer assisted surgery : MRCAS.

[26]  S. Omata,et al.  Micro-mechanical sensing platform for the characterization of the elastic properties of the ovum via uniaxial measurement. , 2004, Journal of biomechanics.

[27]  J. Dargahi,et al.  An integrated force-position tactile sensor for improving diagnostic and therapeutic endoscopic surgery. , 2004, Bio-medical materials and engineering.

[28]  Yoseph Bar-Cohen,et al.  Virtual reality robotic operation simulations using MEMICA Haptic System , 2000 .

[29]  F Tendick,et al.  Measuring in vivo animal soft tissue properties for haptic modeling in surgical simulation. , 2001, Studies in health technology and informatics.

[30]  Ken Ikeuchi,et al.  An endoscopic tactile sensor for low invasive surgery , 2005 .

[31]  Javad Dargahi,et al.  A supported membrane type sensor for medical tactile mapping , 2004 .

[32]  Javad Dargahi,et al.  Advances in tactile sensors design/manufacturing and its impact on robotics applications - a review , 2005, Ind. Robot.

[33]  Rininsland Hh,et al.  Basics of robotics and manipulators in endoscopic surgery. , 1993 .

[34]  Ronald S. Fearing,et al.  Some basic issues in teletaction , 1997, Proceedings of International Conference on Robotics and Automation.

[35]  S. Payandeh,et al.  A micromachined piezoelectric tactile sensor for an endoscopic grasper-theory, fabrication and experiments , 2000, Journal of Microelectromechanical Systems.

[36]  B. Hannaford,et al.  Computerized endoscopic surgical grasper. , 1998, Studies in health technology and informatics.

[37]  Helmut Ermert,et al.  Electrorheological tactel elements , 2005 .