A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Robot Arm

In robotic surgery, the surgeon controls robotic instruments using dedicated interfaces. One critical limitation of current interfaces is that they are designed to be operated by only the hands. This means that the surgeon can only control at most two robotic instruments at one time while many interventions require three instruments. This paper introduces a novel four-degree-of-freedom foot-machine interface which allows the surgeon to control a third robotic instrument using the foot, giving the surgeon a "third hand". This interface is essentially a parallel-serial hybrid mechanism with springs and force sensors. Unlike existing switch-based interfaces that can only un-intuitively generate motion in discrete directions, this interface allows intuitive control of a slave robotic arm in continuous directions and speeds, naturally matching the foot movements with dynamic force & position feedbacks. An experiment with ten naive subjects was conducted to test the system. In view of the significant variance of motion patterns between subjects, a subject-specific mapping from foot movements to command outputs was developed using Independent Component Analysis (ICA). Results showed that the ICA method could accurately identify subjects' foot motion patterns and significantly improve the prediction accuracy of motion directions from 68% to 88% as compared with the forward kinematics-based approach. This foot-machine interface can be applied for the teleoperation of industrial/surgical robots independently or in coordination with hands in the future.

[1]  Sriram Subramanian,et al.  Putting your best foot forward: investigating real-world mappings for foot-based gestures , 2012, CHI.

[2]  Christian Hansen,et al.  Hand, Foot or Voice: Alternative Input Modalities for Touchless Interaction in the Medical Domain , 2018, ICMI.

[3]  Alin Albu-Schäffer,et al.  The sigma.7 haptic interface for MiroSurge: A new bi-manual surgical console , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  A. Rané,et al.  Initial experience with the EndoAssist camera-holding robot in laparoscopic urological surgery , 2007, Journal of robotic surgery.

[5]  Ioannis Poulakakis,et al.  A Switchable Parallel Elastic Actuator and its Application to Leg Design for Running Robots , 2018, IEEE/ASME Transactions on Mechatronics.

[6]  M. Munro Automated laparoscope positioner: preliminary experience. , 1993, The Journal of the American Association of Gynecologic Laparoscopists.

[7]  Etienne Burdet,et al.  Elasticity improves handgrip performance and user experience during visuomotor control , 2017, Royal Society Open Science.

[8]  Elahe Abdi,et al.  Supernumerary Robotic Arm for Three-Handed Surgical Application: Behavioral Study and Design of Human-Machine Interface , 2017 .

[9]  Etienne Burdet,et al.  In a demanding task, three-handed manipulation is preferred to two-handed manipulation , 2016, Scientific Reports.

[10]  G. Buess,et al.  A new remote-controlled endoscope positioning system for endoscopic solo surgery , 2000, Surgical Endoscopy.

[11]  Hans-Werner Gellersen,et al.  Feet movement in desktop 3D interaction , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[12]  J. Bodner,et al.  First experiences with the da Vinci operating robot in thoracic surgery. , 2004, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[13]  Philippe Cinquin,et al.  ViKY Robotic Scope Holder: Initial Clinical Experience and Preliminary Results Using Instrument Tracking , 2010, IEEE/ASME Transactions on Mechatronics.

[14]  Robert A. Baron,et al.  Putting Your Best Foot Forward? , 2004 .

[15]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[16]  Thoralf M Sundt,et al.  Teamwork and communication in the operating room: relationship to discrete outcomes and research challenges. , 2011, Anesthesiology clinics.

[17]  Tatsuo Nakamura,et al.  Hands-free interface for surgical procedures based on foot movement patterns , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  J. M. Sackier,et al.  Robotically assisted laparoscopic surgery , 2008, Surgical Endoscopy.

[19]  R. Polet,et al.  Using a laparoscope manipulator (LAPMAN) in laparoscopic gynecological surgery. , 2008, Surgical technology international.

[20]  Etienne Burdet,et al.  On the analysis of movement smoothness , 2015, Journal of NeuroEngineering and Rehabilitation.

[21]  Jason Alexander,et al.  The Feet in Human--Computer Interaction , 2015, ACM Comput. Surv..

[22]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[23]  Etienne Burdet,et al.  A Robust and Sensitive Metric for Quantifying Movement Smoothness , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Etienne Burdet,et al.  Control of a Supernumerary Robotic Hand by Foot: An Experimental Study in Virtual Reality , 2015, PloS one.

[25]  Jason Noble,et al.  A comparison of hand- and foot-activated surgical tools in simulated ophthalmic surgery. , 2012, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[26]  Alireza Mirbagheri,et al.  Design and development of an effective low-cost robotic cameraman for laparoscopic surgery: RoboLens , 2011 .

[27]  Kenji Suzuki,et al.  Standing Mobility Device With Passive Lower Limb Exoskeleton for Upright Locomotion , 2018, IEEE/ASME Transactions on Mechatronics.

[28]  Khek Yu Ho,et al.  Feasibility of performing esophageal endoscopic submucosal dissection using master and slave transluminal endoscopic robot , 2017, Endoscopy.

[29]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..