Review on aspects of artificial tactile feedback in laparoscopic surgery.

Since direct manual tissue palpation is not possible in laparoscopic surgery, feedback information on tactile tissue properties is considerably diminished. Restoring part of the surgeon's sense of touch through devices capable of providing artificial tactile feedback (ATF) is an active field of applied research and development. Despite more than two decades of research, technical development of such devices is still basic, and pre-clinical as well as clinical experience is limited. This article provides an overview of the technological aspects of ATF in laparoscopic surgery, gives background information on principles of human perception of related feedback information, and reviews current research attempts in the field of ATF systems in laparoscopic surgery, broken down into three main system components: tactile sensor, display, and data processing. Tactile sensors have been developed to measure tissue compliance, reveal hidden structures or foreign bodies in tissue through measurement of pressure distribution, and to identify and locate arteries by detecting their pulsation. Furthermore, different solutions for presenting tactile data to the surgeon have been developed. Visual and auditory displays are easy to implement into the operating room equipment, while tactile displays still suffer from difficulties concerning their performance and requirements for clinical usability. The role of the data processing system as the linking component in an artificial tactile feedback system has been identified as crucial for effectiveness of the system and easy reception of tactile data by the surgeon. The investigations on theoretical and technological foundations of ATF have led to an extensive database in recent years. An application-driven development approach will likely be a driving factor in the future evolution of this field.

[1]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.

[2]  Jörg Wallaschek,et al.  Tactile tissue characterisation by piezoelectric systems , 2008 .

[3]  A. Castellanos,et al.  Force Feedback Plays a Significant Role in Minimally Invasive Surgery: Results and Analysis , 2005, Annals of surgery.

[4]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[5]  Mahdi Tavakoli,et al.  Haptic feedback and sensory substitution during telemanipulated suturing , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[6]  Dominiek Reynaerts,et al.  Tactile sensing data interpretation for object manipulation , 1992 .

[7]  D. Jones,et al.  The influence of three-dimensional video systems on laparoscopic task performance. , 1996, Surgical laparoscopy & endoscopy.

[8]  Jenny Dankelman,et al.  Effectiveness of grasping and duration of clamping using laparoscopic graspers , 2001, Surgical Endoscopy And Other Interventional Techniques.

[9]  D. Yuh,et al.  Effects of visual force feedback on robot-assisted surgical task performance. , 2008, The Journal of thoracic and cardiovascular surgery.

[10]  Javad Dargahi,et al.  Theoretical and experimental analysis of a piezoelectric tactile sensor for use in endoscopic surgery , 2004 .

[11]  J. R. Hewit,et al.  Tactile sensing technology for minimal access surgery––a review , 2003 .

[12]  I. Broeders,et al.  Robot-assisted surgical systems: a new era in laparoscopic surgery. , 2002, Annals of the Royal College of Surgeons of England.

[13]  J. Dargahi,et al.  An endoscopic force-position sensor grasper with minimum sensors , 2003, Canadian Journal of Electrical and Computer Engineering.

[14]  Arianna Menciassi,et al.  Microtechnologies in medicine: An overview , 2007, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[15]  J. Dankelman,et al.  Haptics in minimally invasive surgery – a review , 2008, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[16]  M. Hashizume,et al.  Early experiences of endoscopic procedures in general surgery assisted by a computer-enhanced surgical system , 2002, Surgical Endoscopy And Other Interventional Techniques.

[17]  T. Krummel,et al.  Tactile feedback is present during minimally invasive surgery. , 1999, Journal of the American College of Surgeons.

[18]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring. Review of early clinical results. , 2002, Surgical endoscopy.

[19]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[20]  G. Honderd,et al.  Force reflection for a laparoscopic forceps , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  S Ishiguro,et al.  Diagnosis of the extent of gastric cancers by a new endoscopic ultrasonic tactile sensor. , 2000, Gastrointestinal endoscopy.

[22]  A. Cuschieri,et al.  Minimal access surgery (MAS)-related surgeon morbidity syndromes , 2005, Surgical Endoscopy And Other Interventional Techniques.

[23]  A. Csillag,et al.  The Skin and Other Diffuse Sensory Systems , 2005 .

[24]  Ronald S. Fearing,et al.  A surface micromachined microtactile sensor array , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[25]  A. Cuschieri,et al.  Introduction and Historical Aspects , 1992 .

[26]  Wilfried Mokwa,et al.  Medical implants based on microsystems , 2007 .

[27]  R. Howe,et al.  A Palpation System for Artery Localization in Laparoscopic Surgery , 1994 .

[28]  G. Buess,et al.  Vibrotactile characteristics of different tissues in endoscopic otolaryngologic surgery - in vivo and ex vivo measurements. , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[29]  S. Omata,et al.  Application of a new tactile sensor to thoracoscopic surgery: experimental and clinical study. , 1995, The Annals of thoracic surgery.

[30]  Chellappa Muthukrishnan,et al.  Edge detection in tactile images , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[31]  H. Stassen,et al.  Manipulation in laparoscopic surgery: overview of impeding effects and supporting aids. , 1999, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[32]  M. Shimojo,et al.  A system for simultaneously measuring grasping posture and pressure distribution , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[33]  A. Cuschieri Whither minimal access surgery: tribulations and expectations. , 1995, American journal of surgery.

[34]  Christopher R. Wagner,et al.  A compliant tactile display for teletaction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[35]  H. Stassen,et al.  Human reliability and training in minimally invasive surgery , 2003, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[36]  Warren S. Grundfest,et al.  Optimization of a Pneumatic Balloon Tactile Display for Robot-Assisted Surgery Based on Human Perception , 2008, IEEE Transactions on Biomedical Engineering.

[37]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[38]  Allison M. Okamura,et al.  Force-Feedback Surgical Teleoperator: Controller Design and Palpation Experiments , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[39]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[40]  Javad Dargahi,et al.  Graphical display of tactile sensing data with application in minimally invasive surgery , 2007, Canadian Journal of Electrical and Computer Engineering.

[41]  Antonio Bicchi,et al.  Haptic discrimination of softness in teleoperation: the role of the contact area spread rate , 2000, IEEE Trans. Robotics Autom..

[42]  Kenneth O. Johnson,et al.  The roles and functions of cutaneous mechanoreceptors , 2001, Current Opinion in Neurobiology.

[43]  S. Omata,et al.  The stiffness of lymph nodes containing lung carcinoma metastases , 1997, Cancer.

[44]  Robert D. Howe,et al.  Tactile tracking of arteries in robotic surgery , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[45]  Robert D. Howe,et al.  A holistic model of human touch , 1997 .

[46]  Jens Rassweiler,et al.  Telepresence surgery: first experiences with laparoscopic radical prostatectomy. , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[47]  Øyvind Stavdahl,et al.  Palpation instrument for augmented minimally invasive surgery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[48]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[49]  Miriam Reiner,et al.  Seeing Through Touch: The Role of Haptic Information in Visualization , 2008 .

[50]  A. Castellanos,et al.  Evaluation of a laparoscopic grasper with force feedback. , 2003, Surgical endoscopy.

[51]  Vincent Hayward,et al.  A tactile enhancement instrument for minimally invasive surgery , 2005, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[52]  Mahdi Tavakoli,et al.  Haptics in Telerobotic Systems for Minimally Invasive Surgery , 2008 .

[53]  H. Stassen,et al.  Observation in laparoscopic surgery: overview of impeding effects and supporting aids. , 1999, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[54]  P Van de Walle,et al.  Hand-Assisted Staging Laparoscopy for Suspected Malignancies of the Pancreas , 2002, Acta chirurgica Belgica.

[55]  S. Connor,et al.  Bile duct injury in the era of laparoscopic cholecystectomy , 2006, The British journal of surgery.

[56]  H. G. Stassen,et al.  Rasmussen’s model of human behavior in laparoscopy training , 2003, Surgical Endoscopy And Other Interventional Techniques.

[57]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[58]  J. Perreault,et al.  Effects of experience on force perception threshold in minimally invasive surgery , 2008, Surgical Endoscopy.

[59]  J. L. Herder,et al.  Forces and displacements in colon surgery , 2002, Surgical Endoscopy And Other Interventional Techniques.

[60]  S. Lederman,et al.  TACTUAL PERCEPTION , 2003 .

[61]  Christopher R. Wagner,et al.  A tactile shape display using RC servomotors , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[62]  B Neisius,et al.  Kinematic problems of manipulators for minimal invasive surgery. , 1993, Endoscopic surgery and allied technologies.

[63]  A. Csillag,et al.  Atlas of the sensory organs : functional and clinical anatomy , 2005 .

[64]  Javad Dargahi,et al.  A piezoelectric tactile sensor with three sensing elements for robotic, endoscopic and prosthetic applications , 2000 .

[65]  Helmut Ermert,et al.  Electrorheological tactel elements , 2005 .

[66]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[67]  E. Petter,et al.  Vibrotactile palpation instrument for use in minimal invasive surgery , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[68]  Javad Dargahi,et al.  A novel method in measuring the stiffness of sensed objects with applications for biomedical robotic systems , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[69]  Mitsuhiro Shikida,et al.  Active tactile sensor for detecting contact force and hardness of an object , 2003 .

[70]  Thomas G. Cleaver,et al.  The Sounds of Saturation , 2004, Journal of Clinical Monitoring and Computing.

[71]  V. Velanovich Laparoscopic vs open surgery: a preliminary comparison of quality-of-life outcomes. , 2000, Surgical endoscopy.

[72]  G. Buess,et al.  Robotics and telemanipulation technologies for endoscopic surgery , 2000, Surgical Endoscopy.

[73]  M. O. Schurr Sensors in minimally invasive therapy – a technology coming of age , 2004, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[74]  U. Wallrabe,et al.  Microsystems in Medicine , 1998, The International journal of artificial organs.

[75]  吉田 達也 The Ultrasonic Tactile Sensor : In Vivo Clinical Application for Evaluation of Depth of Invasion in Esophageal Squamous Cell Carcinomas , 2000 .

[76]  A Cuschieri,et al.  Technological aspects of minimal access surgery , 1997, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[77]  Kenneth O. Johnson,et al.  Tactile Functions of Mechanoreceptive Afferents Innervating the Hand , 2000, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[78]  M. Shikida,et al.  Amicromachined active tactile sensor for hardness detection , 2004 .

[79]  G. Buess,et al.  Robotics and telemanipulation technologies for endoscopic surgery. A review of the ARTEMIS project. Advanced Robotic Telemanipulator for Minimally Invasive Surgery. , 2000, Surgical endoscopy.

[80]  Seiji Chonan,et al.  Development of an active palpation sensor for detecting prostate cancer and hypertrophy , 2000 .

[81]  Noemi Bitterman D.Sc. Technologies and Solutions for Data Display in the Operating Room , 2006, Journal of Clinical Monitoring and Computing.

[82]  G. Zimmer,et al.  New tactile sensor chip with silicone rubber cover , 2000 .

[83]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.

[84]  G. F. Buess,et al.  The effect of high-definition imaging on surgical task efficiency in minimally invasive surgery , 2009, Surgical Endoscopy.

[85]  R. Parks,et al.  Guidelines on the management of common bile duct stones (CBDS) , 2008, Gut.

[86]  Christos E. Constantinou,et al.  Real time robotic tactile sensor system for the determination of the physical properties of biomaterials , 2004 .

[87]  Henk G. Stassen,et al.  Internal representation, internal model, human performance model and mental workload , 1988, Autom..

[88]  Warren S. Grundfest,et al.  A Pneumatic Haptic Feedback Actuator Array for Robotic Surgery or Simulation , 2007, MMVR.

[89]  Caroline G. L. Cao,et al.  Can Surgeons Think and Operate with Haptics at the Same Time? , 2007, Journal of Gastrointestinal Surgery.

[90]  A. Cuschieri,et al.  Operative Manual of Endoscopic Surgery 2 , 1994, Springer Berlin Heidelberg.

[91]  R. Rozman,et al.  A new device for the detection and recognition of blood vessels in laparoscopic surgery , 2002, Surgical Endoscopy And Other Interventional Techniques.

[92]  Javad Dargahi,et al.  Design and modeling of an endoscopic piezoelectric tactile sensor , 2005 .

[93]  Marc O Schurr,et al.  Artificial tactile sensing in minimally invasive surgery – a new technical approach , 2006, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[94]  Jenny Dankelman,et al.  Slip and damage properties of jaws of laparoscopic graspers , 2004, Surgical Endoscopy.

[95]  T. Johansen,et al.  The Role of Tactile Feedback in Laparoscopic Surgery , 2006, Surgical laparoscopy, endoscopy & percutaneous techniques.

[96]  H. Oestreicher,et al.  Physics of vibrations in living tissues. , 1952, Journal of applied physiology.

[97]  U. Voges,et al.  Robotics and allied technologies in endoscopic surgery. , 1998, Surgical technology international.

[98]  Warren D. Smith,et al.  Ergonomic problems associated with laparoscopic surgery , 1999, Surgical Endoscopy.

[99]  M. Tirabassi,et al.  Improving tactile sensation in minimally invasive pediatric surgery. , 2007, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[100]  Susumu Sugiyama,et al.  Tactile image detection using a 1k-element silicon pressure sensor array , 1990 .

[101]  E.P. Scilingo,et al.  Haptic display able to replicate the rheological behaviour of surgical tissues , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[102]  R. Berguer,et al.  A comparison of operating room crowding between open and laparoscopic operations , 1996, Surgical Endoscopy.

[103]  J Dargahi,et al.  Human tactile perception as a standard for artificial tactile sensing—a review , 2004, The international journal of medical robotics + computer assisted surgery : MRCAS.

[104]  G. Sung,et al.  Robotic laparoscopic surgery: a comparison of the DA Vinci and Zeus systems. , 2001, Urology.

[105]  R. Fitzgibbons,et al.  Hand-assisted laparoscopic surgery (HALS): a useful technique for complex laparoscopic abdominal procedures. , 1998, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[106]  J. Dankelman,et al.  Friction dynamics of trocars , 2006, Surgical Endoscopy.

[107]  W. Sjoerdsma,et al.  Sensitivity of laparoscopic dissectors , 1999, Surgical Endoscopy.

[108]  A. Park,et al.  Advanced Devices for the Operating Room of the Future , 2003, Seminars in laparoscopic surgery.

[109]  Øyvind Stavdahl,et al.  Electromechanical design of a miniature tactile shape display for minimally invasive surgery , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[110]  Antonio Bicchi,et al.  A sensor-based minimally invasive surgery tool for detecting tissutal elastic properties(003) 5323219 , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[111]  Eric Maël,et al.  A sensor for dynamic tactile information with applications in human-robot interaction and object exploration , 2006, Robotics Auton. Syst..

[112]  Earl Gaar,et al.  Errors in laparoscopic surgery , 2004, Journal of surgical oncology.

[113]  Miriam Reiner,et al.  Visualization : theory and practice in science education , 2008 .

[114]  R.V. Patel,et al.  Multi-sensory force/deformation cues for stiffness characterization in soft-tissue palpation , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[115]  Thomas Parisini,et al.  Towards the realization of an artificial tactile system: fine-form discrimination by a tensorial tactile sensor array and neural inversion algorithms , 1995, IEEE Trans. Syst. Man Cybern..

[116]  Jenny Dankelman,et al.  Man-machine aspects of minimally invasive surgery , 1998, Annu. Rev. Control..

[117]  William J. Peine,et al.  Tactile Imaging System for Localizing Lung Nodules during Video Assisted Thoracoscopic Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[118]  M.S. Pridham,et al.  Force‐sensitive tactile sensor for minimal access surgery , 2004, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[119]  Javad Dargahi,et al.  A supported membrane type sensor for medical tactile mapping , 2004 .

[120]  G. Picod,et al.  What can the operator actually feel when performing a laparoscopy? , 2003, Surgical Endoscopy And Other Interventional Techniques.

[121]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[122]  W R Walsh,et al.  High pressures are generated at the tip of laparoscopic graspers. , 1999, The Australian and New Zealand journal of surgery.

[123]  G. Campos,et al.  Laparoscopic finger-assisted technique (fingeroscopy) for treatment of complicated appendicitis. , 1999, Journal of the American College of Surgeons.

[124]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[125]  M. Moallem,et al.  Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment , 2006, Surgical Endoscopy And Other Interventional Techniques.

[126]  Christopher J. Martin,et al.  Grasper trauma during laparoscopic cholecystectomy. , 2000, The Australian and New Zealand journal of surgery.

[127]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[128]  Breedveld Wentink,et al.  Eye-hand coordination in laparoscopy - an overview of experiments and supporting aids , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[129]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.