The Effect of Trial-by-Trial Adaptation on Conflicts in Haptic Shared Control for Free-Air Teleoperation Tasks

Haptic shared control can improve execution of teleoperation and driving tasks. However, shared control designs may suffer from conflicts between individual human operators and constant haptic assistance when their desired trajectories differ, leading to momentarily increased forces, discomfort, or even deteriorated performance. This study investigates ways to reduce conflicts between individual human operators and a haptic shared controller by modifying supported trajectories. Subjects (n=12) performed a repetitive movement task in an abstract environment with varying spatio-temporal constraints, both during manual control and while supported by haptic shared control. Four types of haptic shared control were compared, combining two design properties: the initial supported trajectory (either the centerline of the environment or an individualized trajectory based on manual control trials), and trial-by-trial adaptation of guidance towards previously performed trajectories (either present or absent). Trial-by-trial adaptation of guidance reduced conflicts compared to non-adaptive guidance, whether the initial trajectory was individualized or not. Without trial-by-trial adaptation, individualized trajectories also reduced conflicts, but not completely: when guided, operators adapt their preferred trajectories. In conclusion, trial-by-trial adaptation is the most promising approach to mitigate conflicts during repetitive motion tasks.

[1]  Saïd Mammar,et al.  Driver's influence on the performance of an integrated lane departure avoidance and lane keeping assistance system , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[2]  Franck Mars,et al.  Driver adaptation to haptic shared control of the steering wheel , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  Mario Milanese,et al.  Combined Automatic Lane-Keeping and Driver's Steering Through a 2-DOF Control Strategy , 2009, IEEE Transactions on Control Systems Technology.

[4]  Allison M. Okamura,et al.  Effect of virtual fixture compliance on human-machine cooperative manipulation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Mark Mulder,et al.  Balancing safety and support: Changing lanes with a haptic lane-keeping support system , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[6]  Allison M. Okamura,et al.  Recognition of operator motions for real-time assistance using virtual fixtures , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[7]  René van Paassen,et al.  Adapting haptic guidance authority based on user grip , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Martin Buss,et al.  Role determination in human-human interaction , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[9]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[10]  Allison M. Okamura,et al.  Speed-Accuracy Characteristics of Human-Machine Cooperative Manipulation Using Virtual Fixtures With Variable Admittance , 2004, Hum. Factors.

[11]  Karon E. MacLean,et al.  Predictive haptic guidance: intelligent user assistance for the control of dynamic tasks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[12]  Marcia Kilchenman O'Malley,et al.  The Task-Dependent Efficacy of Shared-Control Haptic Guidance Paradigms , 2012, IEEE Transactions on Haptics.

[13]  M Maarten Steinbuch,et al.  Task analysis of human-in-the-loop tele-operated maintenance: What can be learned from JET? , 2014 .

[14]  Joris De Schutter,et al.  Haptic Obstacle Avoidance for Intuitive Powered Wheelchair Navigation , 2012 .

[15]  J. Patton,et al.  Can Robots Help the Learning of Skilled Actions? , 2009, Exercise and sport sciences reviews.

[16]  R. Brent Gillespie,et al.  Sharing Control Between Humans and Automation Using Haptic Interface: Primary and Secondary Task Performance Benefits , 2005, Hum. Factors.

[17]  Martin Buss,et al.  Design and Evaluation of a Haptic Computer-Assistant for Telemanipulation Tasks , 2013, IEEE Transactions on Human-Machine Systems.

[18]  Martin Buss,et al.  A Survey of Environment-, Operator-, and Task-adapted Controllers for Teleoperation Systems , 2010 .

[19]  René van Paassen,et al.  Understanding and reducing conflicts between driver and haptic shared control , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Gregory D. Hager,et al.  Human-Machine Collaborative Systems for Microsurgical Applications , 2005, Int. J. Robotics Res..

[21]  Takashi Minato,et al.  Physical Human-Robot Interaction: Mutual Learning and Adaptation , 2012, IEEE Robotics & Automation Magazine.

[22]  Gerald J.S. Wilde,et al.  The Theory of Risk Homeostasis: Implications for Safety and Health , 1982 .

[23]  M. M. van Paassen,et al.  Design and Evaluation of a Haptic Flight Director , 2006 .

[24]  Göran A. V. Christiansson,et al.  Hard Master-Soft Slave Haptic Teleoperation , 2002 .

[25]  David A. Abbink,et al.  Should Drivers Be Operating Within an Automation-Free Bandwidth? Evaluating Haptic Steering Support Systems With Different Levels of Authority , 2015, Hum. Factors.

[26]  Cagatay Basdogan,et al.  Haptic guidance for improved task performance in steering microparticles with optical tweezers. , 2007, Optics express.

[27]  Frans C. T. van der Helm,et al.  A Task-Specific Analysis of the Benefit of Haptic Shared Control During Telemanipulation , 2013, IEEE Transactions on Haptics.

[28]  Angelika Peer,et al.  Exploring the Design Space of Haptic Assistants: The Assistance Policy Module , 2013, IEEE Transactions on Haptics.

[29]  Frans C. T. van der Helm,et al.  The Impact of Haptic Feedback Quality on the Performance of Teleoperated Assembly Tasks , 2013, IEEE Transactions on Haptics.

[30]  Frans C. T. van der Helm,et al.  Influence of haptic guidance in learning a novel visuomotor task , 2009, Journal of Physiology-Paris.

[31]  Danica Kragic,et al.  Adaptive Virtual Fixtures for Machine-Assisted Teleoperation Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[33]  Sandra Hirche,et al.  Performance related energy exchange in haptic human-human interaction in a shared virtual object manipulation task , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[34]  Martin Buss,et al.  Towards real-time haptic assistance adaptation optimizing task performance and human effort , 2011, 2011 IEEE World Haptics Conference.

[35]  Danica Kragic,et al.  Online task recognition and real-time adaptive assistance for computer-aided machine control , 2006, IEEE Transactions on Robotics.

[36]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[37]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[38]  A. Berthoz,et al.  Relationship between velocity and curvature of a human locomotor trajectory , 2001, Neuroscience Letters.

[39]  René van Paassen,et al.  Neuromuscular analysis based tuning of haptic shared control assistance for UAV collision avoidance , 2013, 2013 World Haptics Conference (WHC).

[40]  Mark Mulder,et al.  Sharing Control With Haptics , 2012, Hum. Factors.

[41]  Allison M. Okamura,et al.  Haptic Virtual Fixtures for Robot-Assisted Manipulation , 2005, ISRR.

[42]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[43]  T. Flash,et al.  Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. , 1995, Journal of experimental psychology. Human perception and performance.

[44]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[45]  Mark Mulder,et al.  Neuromuscular Analysis as a Guideline in designing Shared Control , 2010 .

[46]  Jing-Fu Liu,et al.  Development of an Interactive Lane Keeping Control System for Vehicle , 2007, 2007 IEEE Vehicle Power and Propulsion Conference.

[47]  Joost C. F. de Winter,et al.  Preparing drivers for dangerous situations: A critical reflection on continuous shared control , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[48]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.