Intuitive operability evaluation of surgical robot using brain activity measurement to determine immersive reality

Surgical robots have improved considerably in recent years, but intuitive operability, which represents user inter-operability, has not been quantitatively evaluated. Therefore, for design of a robot with intuitive operability, we propose a method to measure brain activity to determine intuitive operability. The objective of this paper is to determine the master configuration against the monitor that allows users to perceive the manipulator as part of their own body. We assume that the master configuration produces an immersive reality experience for the user of putting his own arm into the monitor. In our experiments, as subjects controlled the hand controller to position the tip of the virtual slave manipulator on a target in a surgical simulator, we measured brain activity through brain-imaging devices. We performed our experiments for a variety of master manipulator configurations with the monitor position fixed. For all test subjects, we found that brain activity was stimulated significantly when the master manipulator was located behind the monitor. We conclude that this master configuration produces immersive reality through the body image, which is related to visual and somatic sense feedback.

[1]  E. Cassirer Philosophie der symbolischen Formen , 1935 .

[2]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[3]  Masakatsu G. Fujie,et al.  Intuitive operability evaluation of robotic surgery using brain activity measurement to identify hand-eye coordination , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Darius Burschka,et al.  DaVinci Canvas: A Telerobotic Surgical System with Integrated, Robot-Assisted, Laparoscopic Ultrasound Capability , 2005, MICCAI.

[5]  Yasuo Kuniyoshi,et al.  Adaptive body schema for robotic tool-use , 2006, Adv. Robotics.

[6]  R. A. Fisher,et al.  Design of Experiments , 1936 .

[7]  Mukul Mukherjee,et al.  Training program for fundamental surgical skill in robotic laparoscopic surgery , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[9]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring. Review of early clinical results. , 2002, Surgical endoscopy.

[10]  Atsushi Iriki,et al.  Tools for the body , 2004 .

[11]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[12]  Dottie M. Clower,et al.  Selective use of perceptual recalibration versus visuomotor skill acquisition. , 2000, Journal of neurophysiology.

[13]  N. Kanwisher,et al.  Neuroimaging of cognitive functions in human parietal cortex , 2001, Current Opinion in Neurobiology.

[14]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[15]  R. Homan,et al.  Cerebral location of international 10-20 system electrode placement. , 1987, Electroencephalography and clinical neurophysiology.

[16]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[17]  A. Berthelet,et al.  The Use of tools by human and non-human primates , 1993 .

[18]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[19]  Pedro F Escobar,et al.  Laparoendoscopic single-site surgery (LESS) in gynecologic oncology: technique and initial report. , 2009, Gynecologic oncology.

[20]  Masaya Hirashima,et al.  The “Cutaneous Rabbit” Hopping out of the Body , 2010, The Journal of Neuroscience.

[21]  Alois Knoll,et al.  Framework of automatic robot surgery system using Visual servoing , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  R. Andersen Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[23]  Goro Maehara,et al.  Hemodynamic changes in response to the stimulated visual quadrants: a study with 24-channel near-infrared spectroscopy (特集 脳機能計測と基礎心理学) , 2009 .

[24]  Goro Maehara,et al.  Changes in hemoglobin concentration in the lateral occipital regions during shape recognition: a near-infrared spectroscopy study. , 2007, Journal of biomedical optics.

[25]  Francisco J. Valero Cuevas,et al.  Reported anatomical variability naturally leads to multimodal distributions of Denavit-Hartenberg parameters for the human thumb , 2006, IEEE Transactions on Biomedical Engineering.