Tri-Manipulation: An Evaluation of Human Performance in 3-Handed Teleoperation

With a third hand a human subject could be able to perform tasks that they would otherwise be incapable of. Foot-controlled interfaces have proven suitable for controlling robot arms, however, when it is best to use such devices and what limitations they place when controlling a supernumerary robotic limb (SL) in combination with the natural limbs (NLs) is unknown. Here, we report an investigation of three-handed manipulation with a foot interface. We analysed i) what effect the addition of a SL has on the performance of the NLs; and ii) how mechanical and/or cognitive coupling alters user performance. When the subjects moved the three limbs without coupling, only the motion’s completion time was observed to be significantly affected. In contrast with coupling, the incorporation of the foot controlled hand was found to affect the success rate, and planning of the motion, however it did not affect motion characteristics such as smoothness.

[1]  Alexandre Gramfort,et al.  Automated model selection in covariance estimation and spatial whitening of MEG and EEG signals , 2015, NeuroImage.

[2]  Herbert Heuer,et al.  Chapter 3 Coordination , 1996 .

[3]  Hans-Werner Gellersen,et al.  Interactions Under the Desk: A Characterisation of Foot Movements for Input in a Seated Position , 2015, INTERACT.

[4]  Etienne Burdet,et al.  In a demanding task, three-handed manipulation is preferred to two-handed manipulation , 2016, Scientific Reports.

[5]  Toshiyuki Kondo,et al.  A proposal of EMG-based teleoperation interface for distance mobility , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[6]  J D Cohen,et al.  Multitasking versus multiplexing: Toward a normative account of limitations in the simultaneous execution of control-demanding behaviors , 2014, Cognitive, affective & behavioral neuroscience.

[7]  Christian Cipriani,et al.  Control of a Robotic Hand Using a Tongue Control System—A Prosthesis Application , 2016, IEEE Transactions on Biomedical Engineering.

[8]  Thoralf M Sundt,et al.  Teamwork and communication in the operating room: relationship to discrete outcomes and research challenges. , 2011, Anesthesiology clinics.

[9]  Etienne Burdet,et al.  A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Surgical Robot , 2020, IEEE/ASME Transactions on Mechatronics.

[10]  Etienne Burdet,et al.  On the analysis of movement smoothness , 2015, Journal of NeuroEngineering and Rehabilitation.

[11]  H N Zelaznik,et al.  Spatial topological constraints in a bimanual task. , 1991, Acta psychologica.

[12]  Hannes Bleuler,et al.  Four-Arm Manipulation via Feet Interfaces , 2019, ArXiv.

[13]  A. Rané,et al.  Initial experience with the EndoAssist camera-holding robot in laparoscopic urological surgery , 2007, Journal of robotic surgery.

[14]  Guang-Zhong Yang,et al.  Gaze gesture based human robot interaction for laparoscopic surgery , 2018, Medical Image Anal..

[15]  Kai Kunze,et al.  MetaArms: Body Remapping Using Feet-Controlled Artificial Arms , 2018, UIST.