Human-Centered Design and Evaluation of Haptic Cueing for Teleoperation of Multiple Mobile Robots

In this paper, we investigate the effect of haptic cueing on a human operator's performance in the field of bilateral teleoperation of multiple mobile robots, particularly multiple unmanned aerial vehicles (UAVs). Two aspects of human performance are deemed important in this area, namely, the maneuverability of mobile robots and the perceptual sensitivity of the remote environment. We introduce metrics that allow us to address these aspects in two psychophysical studies, which are reported here. Three fundamental haptic cue types were evaluated. The Force cue conveys information on the proximity of the commanded trajectory to obstacles in the remote environment. The Velocity cue represents the mismatch between the commanded and actual velocities of the UAVs and can implicitly provide a rich amount of information regarding the actual behavior of the UAVs. Finally, the Velocity+Force cue is a linear combination of the two. Our experimental results show that, while maneuverability is best supported by the Force cue feedback, perceptual sensitivity is best served by the Velocity cue feedback. In addition, we show that large gains in the haptic feedbacks do not always guarantee an enhancement in the teleoperator's performance.

[1]  Lennart Ljung,et al.  On the estimation of transfer functions , 1985, Autom..

[2]  Yoram Koren,et al.  Teleautonomous guidance for mobile robots , 1990, IEEE Trans. Syst. Man Cybern..

[3]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[4]  Mark L. Nagurka,et al.  Dynamic and loaded impedance components in the maintenance of human arm posture , 1993, IEEE Trans. Syst. Man Cybern..

[5]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[6]  M. Fliess,et al.  Flatness and defect of non-linear systems: introductory theory and examples , 1995 .

[7]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[8]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[9]  R. Murray,et al.  Real‐time trajectory generation for differentially flat systems , 1998 .

[10]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[11]  E A Clancy,et al.  Estimation and application of EMG amplitude during dynamic contractions. , 2001, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[12]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[13]  A. Benallegue,et al.  Exact linearization and noninteracting control of a 4 rotors helicopter via dynamic feedback , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[14]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[15]  Alana Sherman,et al.  Design of bilateral teleoperation controllers for haptic exploration and telemanipulation of soft environments , 2002, IEEE Trans. Robotics Autom..

[16]  Claudio Melchiorri,et al.  Teleoperation of a mobile robot through haptic feedback , 2002, IEEE International Workshop HAVE Haptic Virtual Environments and Their.

[17]  Maja J. Matarić,et al.  Principled Approaches to the Design of Multi-Robot Systems , 2004 .

[18]  Michael Goldfarb,et al.  Loop shaping for transparency and stability robustness in bilateral telemanipulation , 2004, IEEE Transactions on Robotics and Automation.

[19]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[20]  Angel Rubio,et al.  Experimental quantitative comparison of different control architectures for master-slave teleoperation , 2004, IEEE Transactions on Control Systems Technology.

[21]  Hendrik Van Brussel,et al.  Reliable and Enhanced Stiffness Perception in Soft-tissue Telemanipulation , 2005, Int. J. Robotics Res..

[22]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[24]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Kimon P. Valavanis,et al.  Advances in Unmanned Aerial Vehicles: State of the Art and the Road to Autonomy , 2007 .

[26]  Robert E. Mahony,et al.  A Practical Visual Servo Control for an Unmanned Aerial Vehicle , 2008, IEEE Transactions on Robotics.

[27]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Yasuyoshi Yokokohji,et al.  Maneuverability of master control devices considering the musculo-skeletal model of an operator , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[29]  Shahin Sirouspour,et al.  Nonlinear and Filtered Force/Position Mappings in Bilateral Teleoperation With Application to Enhanced Stiffness Discrimination , 2009, IEEE Transactions on Robotics.

[30]  Peter I. Corke,et al.  A novel approach to haptic tele-operation of aerial robot vehicles , 2010, 2010 IEEE International Conference on Robotics and Automation.

[31]  Dongjun Lee,et al.  Passive-Set-Position-Modulation Framework for Interactive Robotic Systems , 2010, IEEE Transactions on Robotics.

[32]  Dusan M. Stipanovic,et al.  Bilateral Teleoperation of Multiple Mobile Agents: Coordinated Motion and Collision Avoidance , 2010, IEEE Transactions on Control Systems Technology.

[33]  Dongjun Lee Passive Decomposition and Control of Nonholonomic Mechanical Systems , 2010, IEEE Transactions on Robotics.

[34]  Marco Vicentini,et al.  Perception-centric Force Scaling in Bilateral Teleoperation , 2010 .

[35]  Antonio Franchi,et al.  Measuring an operator's maneuverability performance in the haptic teleoperation of multiple robots , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Jake J. Abbott,et al.  On the Ability of Humans to Apply Controlled Forces to Admittance-Type Devices , 2011, Adv. Robotics.

[37]  Farrokh Janabi-Sharifi,et al.  Experimental Analysis of Mobile-Robot Teleoperation via Shared Impedance Control , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Antonio Franchi,et al.  Haptic teleoperation of multiple unmanned aerial vehicles over the internet , 2011, 2011 IEEE International Conference on Robotics and Automation.

[39]  H. Hashimoto,et al.  Enhancement in Operator's Perception of Soft Tissues and Its Experimental Validation for Scaled Teleoperation Systems , 2011, IEEE/ASME Transactions on Mechatronics.

[40]  Frans C. T. van der Helm,et al.  Measuring Neuromuscular Control Dynamics During Car Following With Continuous Haptic Feedback , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Antonio Franchi,et al.  A passivity-based decentralized approach for the bilateral teleoperation of a group of UAVs with switching topology , 2011, 2011 IEEE International Conference on Robotics and Automation.

[42]  Antonio Franchi,et al.  An evaluation of haptic cues on the tele-operator's perceptual awareness of multiple UAVs' environments , 2011, 2011 IEEE World Haptics Conference.

[43]  Joost Venrooij,et al.  A Method to Measure the Relationship Between Biodynamic Feedthrough and Neuromuscular Admittance , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).