A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Surgical Robot

This article introduces a passive four-degree-of-freedom foot interface to control a robotic surgical instrument. This interface is based on a parallel–serial hybrid mechanism with springs and force sensors. In contrast to existing switch-based interfaces that can command a slave robot arm at constant speed in only discrete directions, the novel interface provides an operator with intuitive control in continuous directions and speed with force and position feedback. The output command of the interface was initially derived based on the kinematics and statics of the interface. Since distinct movement patterns among different subjects were observed in a pilot test, a data-driven approach using independent component analysis was developed to convert the foot inputs to the control commands of the user. The capability of this interface in controlling a robotic arm in multiple degrees of freedom was further verified with a teleoperation test.

[1]  Khek Yu Ho,et al.  Sewing up the Wounds: A Robotic Suturing System for Flexible Endoscopy , 2020, IEEE Robotics & Automation Magazine.

[2]  Hongan Wang,et al.  Foot Menu: Using Heel Rotation Information for Menu Selection , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[3]  Christian Hansen,et al.  Hand, Foot or Voice: Alternative Input Modalities for Touchless Interaction in the Medical Domain , 2018, ICMI.

[4]  Alin Albu-Schäffer,et al.  The sigma.7 haptic interface for MiroSurge: A new bi-manual surgical console , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jason Noble,et al.  A comparison of hand- and foot-activated surgical tools in simulated ophthalmic surgery. , 2012, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[6]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[7]  R. Polet,et al.  Using a laparoscope manipulator (LAPMAN) in laparoscopic gynecological surgery. , 2008, Surgical technology international.

[8]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[9]  A. Rané,et al.  Initial experience with the EndoAssist camera-holding robot in laparoscopic urological surgery , 2007, Journal of robotic surgery.

[10]  Philippe Cinquin,et al.  ViKY Robotic Scope Holder: Initial Clinical Experience and Preliminary Results Using Instrument Tracking , 2010, IEEE/ASME Transactions on Mechatronics.

[11]  ラビー，キース・フィリップ,et al.  Automatic endoscope system for optimal positioning , 1993 .

[12]  Takeo Igarashi,et al.  Exploring Subtle Foot Plantar-based Gestures with Sock-placed Pressure Sensors , 2015, CHI.

[13]  Elahe Abdi,et al.  Supernumerary Robotic Arm for Three-Handed Surgical Application: Behavioral Study and Design of Human-Machine Interface , 2017 .

[14]  Henk Nijmeijer,et al.  Design of a minimally invasive surgical teleoperated master-slave system with haptic feedback , 2009, 2009 International Conference on Mechatronics and Automation.

[15]  Etienne Burdet,et al.  In a demanding task, three-handed manipulation is preferred to two-handed manipulation , 2016, Scientific Reports.

[16]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[17]  Lin Cao,et al.  Hybrid Compliant Mechanism Design Using a Mixed Mesh of Flexure Hinge Elements and Beam Elements Through Topology Optimization , 2015 .

[18]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[19]  Thoralf M Sundt,et al.  Teamwork and communication in the operating room: relationship to discrete outcomes and research challenges. , 2011, Anesthesiology clinics.

[20]  Kai Kunze,et al.  MetaArms: Body Remapping Using Feet-Controlled Artificial Arms , 2018, UIST.

[21]  Allan T. Dolovich,et al.  Topology optimization of efficient and strong hybrid compliant mechanisms using a mixed mesh of beams and flexure hinges with strength control , 2018 .

[22]  Kenji Suzuki,et al.  Standing Mobility Device With Passive Lower Limb Exoskeleton for Upright Locomotion , 2018, IEEE/ASME Transactions on Mechatronics.

[23]  Jason Alexander,et al.  The Feet in Human--Computer Interaction , 2015, ACM Comput. Surv..

[24]  Hans-Werner Gellersen,et al.  Interactions Under the Desk: A Characterisation of Foot Movements for Input in a Seated Position , 2015, INTERACT.

[25]  J. M. Sackier,et al.  Robotically assisted laparoscopic surgery , 2008, Surgical Endoscopy.

[26]  Alireza Mirbagheri,et al.  Operation and Human Clinical Trials of RoboLens: an Assistant Robot for Laparoscopic Surgery , 2015 .

[27]  Lin Cao,et al.  A Novel Robotic Suturing System for Flexible Endoscopic Surgery , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[28]  Lin Cao,et al.  Performance Evaluation of a Foot Interface to Operate a Robot Arm , 2019, IEEE Robotics and Automation Letters.

[29]  Jeremy R. Cooperstock,et al.  Pressure or Movement? Usability of Multi-Functional Foot-Based Interfaces , 2018, Conference on Designing Interactive Systems.

[30]  Hans-Werner Gellersen,et al.  Feet movement in desktop 3D interaction , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[31]  J. Bodner,et al.  First experiences with the da Vinci operating robot in thoracic surgery. , 2004, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[32]  Arend L. Schwab,et al.  Toward a Unified Design Approach for Both Compliant Mechanisms and Rigid-Body Mechanisms: Module Optimization , 2015 .

[33]  M.C. Carrozza,et al.  A Wearable Biomechatronic Interface for Controlling Robots with Voluntary Foot Movements , 2007, IEEE/ASME Transactions on Mechatronics.

[34]  Etienne Burdet,et al.  Control of a Supernumerary Robotic Hand by Foot: An Experimental Study in Virtual Reality , 2015, PloS one.