Control of a Supernumerary Robotic Hand by Foot: An Experimental Study in Virtual Reality

In the operational theater, the surgical team could highly benefit from a robotic supplementary hand under the surgeon’s full control. The surgeon may so become more autonomous; this may reduce communication errors with the assistants and take over difficult tasks such as holding tools without tremor. In this paper, we therefore examine the possibility to control a third robotic hand with one foot’s movements. Three experiments in virtual reality were designed to assess the feasibility of this control strategy, the learning curve of the subjects in different tasks and the coordination of foot movements with the two natural hands. Results show that the limbs are moved simultaneously, in parallel rather than serially. Participants’ performance improved within a few minutes of practice without any specific difficulty to complete the tasks. Subjective assessment by the subjects indicated that controlling a third hand by foot has been easy and required only negligible physical and mental efforts. The sense of ownership was reported to improve through the experiments. The mental burden was not directly related to the level of motion required by a task, but depended on the type of activity and practice. The most difficult task was moving two hands and foot in opposite directions. These results suggest that a combination of practice and appropriate tasks can enhance the learning process for controlling a robotic hand by foot.

[1]  Floris Ernst,et al.  Medical Robotics , 2015, Springer International Publishing.

[2]  Philippe Cinquin,et al.  Development of miniaturized light endoscope-holder robot for laparoscopic surgery , 2007, Journal of endourology.

[3]  Stéphane Natkin,et al.  Measuring the level of difficulty in single player video games , 2011, Entertain. Comput..

[4]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[5]  Lars Nyberg,et al.  Cognitive and neural plasticity in aging: General and task-specific limitations , 2006, Neuroscience & Biobehavioral Reviews.

[6]  Jérôme Dupire,et al.  Entertainment Computing – ICEC 2009 , 2009, Lecture Notes in Computer Science.

[7]  T. Bolin Gastrointestinal endoscopy , 1992, The Medical journal of Australia.

[8]  Valeria I. Petkova,et al.  Integration of visual and tactile signals from the hand in the human brain: an FMRI study. , 2011, Journal of neurophysiology.

[9]  R. Polet,et al.  Using a laparoscope manipulator (LAPMAN) in laparoscopic gynecological surgery. , 2008, Surgical technology international.

[10]  M.C. Carrozza,et al.  A Wearable Biomechatronic Interface for Controlling Robots with Voluntary Foot Movements , 2007, IEEE/ASME Transactions on Mechatronics.

[11]  Robert Stanton,et al.  Minimally Invasive Medical Technology , 2001 .

[12]  Lorelei Lingard,et al.  Team Communications in the Operating Room: Talk Patterns, Sites of Tension, and Implications for Novices , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[13]  Roger Newport,et al.  Fake hands in action: embodiment and control of supernumerary limbs , 2009, Experimental Brain Research.

[14]  Maria V. Sanchez-Vives,et al.  Towards a Digital Body: The Virtual Arm Illusion , 2008, Frontiers in human neuroscience.

[15]  Peter Alken,et al.  Hans Christian Jacobaeus: Inventor of human laparoscopy and thoracoscopy. , 2006, Journal of endourology.

[16]  Hannes Bleuler,et al.  Social interaction probed by reaching to face images: Rhesus monkeys consider a textured monkey avatar as a conspecific. , 2011 .

[17]  Thoralf M Sundt,et al.  Teamwork and communication in the operating room: relationship to discrete outcomes and research challenges. , 2011, Anesthesiology clinics.

[18]  A W Partin,et al.  Comparison of robotic versus human laparoscopic camera control . , 1995, The Journal of urology.

[19]  Giovanni Gentile,et al.  The Invisible Hand Illusion: Multisensory Integration Leads to the Embodiment of a Discrete Volume of Empty Space , 2013, Journal of Cognitive Neuroscience.

[20]  Philippe Cinquin,et al.  ViKY Robotic Scope Holder: Initial Clinical Experience and Preliminary Results Using Instrument Tracking , 2010, IEEE/ASME Transactions on Mechatronics.

[21]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[22]  Dong-Soo Kwon,et al.  Intelligent Laparoscopic Assistant Robot through Surgery Task Model: How to Give Intelligence to Medical Robots , 2008 .

[23]  R. Leach The learning curve , 1992 .

[24]  Mark S Humayun,et al.  Comparison of Reaction Response Time between Hand and Foot Controlled Devices in Simulated Microsurgical Testing , 2014, BioMed research international.

[25]  A. Ali,et al.  The use of robotics in surgery: a review , 2014, International journal of clinical practice.

[26]  Glenn Walker,et al.  Minimally Invasive Surgical Robotics , 2001 .

[27]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[28]  George J. Andersen,et al.  Age-Related Declines of Stability in Visual Perceptual Learning , 2014, Current Biology.

[29]  H. Ehrsson,et al.  Disintegration of Multisensory Signals from the Real Hand Reduces Default Limb Self-Attribution: An fMRI Study , 2013, The Journal of Neuroscience.

[30]  N. Smelser,et al.  International Encyclopedia of the Social and Behavioral Sciences , 2001 .

[31]  A. Rané,et al.  Initial experience with the EndoAssist camera-holding robot in laparoscopic urological surgery , 2007, Journal of robotic surgery.

[32]  Peter Hillemanns,et al.  Evaluation of active camera control systems in gynecological surgery: construction, handling, comfort, surgeries and results , 2014, Archives of Gynecology and Obstetrics.

[33]  Li-Ming Su,et al.  Comparison of surgical performance during laparoscopic radical prostatectomy of two robotic camera holders, EndoAssist and AESOP: a pilot study. , 2006, Urology.

[34]  Sashi S. Kommu,et al.  653 INITIAL EXPERIENCE WITH THE ENDOASSIST© CAMERA HOLDING ROBOT IN LAPAROSCOPIC UROLOGICAL SURGERY , 2007 .

[35]  Federico Parietti,et al.  Demonstration-based control of supernumerary robotic limbs , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  H. Harry Asada,et al.  Dynamic analysis and state estimation for wearable robotic limbs subject to human-induced disturbances , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  H. Henrik Ehrsson,et al.  The Illusion of Owning a Third Arm , 2011, PloS one.

[38]  Mel Slater,et al.  Inducing a virtual hand ownership illusion through a brain–computer interface , 2009, Neuroreport.

[39]  H. Henrik Ehrsson,et al.  Being Barbie: The Size of One’s Own Body Determines the Perceived Size of the World , 2011, PloS one.

[40]  S. Unger,et al.  AESOP robotic arm , 1994, Surgical Endoscopy.

[41]  J Dagan,et al.  Endoassist, a mechanical device to support an endoscope. , 1982, Gastrointestinal endoscopy.

[42]  J. Donnez,et al.  Gynecologic laparoscopic surgery with a palm-controlled laparoscope holder. , 2004, The Journal of the American Association of Gynecologic Laparoscopists.

[43]  O. Blanke,et al.  Body ownership and embodiment: Vestibular and multisensory mechanisms , 2008, Neurophysiologie Clinique/Clinical Neurophysiology.

[44]  M. Tsakiris,et al.  Hands only illusion: multisensory integration elicits sense of ownership for body parts but not for non-corporeal objects , 2010, Experimental Brain Research.

[45]  Stéphane Natkin,et al.  Scaling the Level of Difficulty in Single Player Video Games , 2009, ICEC.

[46]  A. Farnè,et al.  The Rubber Hand Illusion: Two’s a company, but three’s a crowd , 2012, Consciousness and Cognition.