Evaluating path planning in human-robot teams: Quantifying path agreement and mental model congruency

The integration of robotic systems into daily life is increasing, as technological advancements facilitate independent and interdependent decision-making by autonomous agents. Highly collaborative human-robot teams promise to maximize the capabilities of humans and machines. While a great deal of progress has been made toward developing efficient spatial path planning algorithms for robots, comparatively less attention has been paid to developing reliable means by which to assess the similarities and differences in path planning decisions and associated behaviors of humans and robots in these teams. This paper discusses a tool, the Algorithm for finding the Least Cost Areal Mapping between Paths (ALCAMP), which can be used to compare paths planned by humans and algorithms in order to quantify the differences between them, and understand the user's mental models underlying those decisions. In addition, this paper discusses prior and proposed future research related to human-robot collaborative teams. Prior studies using ALCAMP have measured path divergence in order to quantify error, infer decision-making processes, assess path memory, and assess team communication performance. Future research related to human-robot teaming includes measuring formation and path adherence, testing the repeatability of navigation algorithms and the clarity of communicated navigation instructions, inferring shared mental models for navigation among members of a group, and detecting anomalous movement.

[1]  Elizabeth S. Veinott,et al.  An optimization approach for mapping and measuring the divergence and correspondence between paths , 2015, Behavior Research Methods.

[2]  Alexandra Kirsch,et al.  Influence of legibility on perceived safety in a virtual human-robot path crossing task , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Takayuki Kanda,et al.  Navigation for human-robot interaction tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  Twan Dollevoet,et al.  Robust UAV mission planning , 2011, Ann. Oper. Res..

[5]  Elizabeth Sklar,et al.  Learning Spatial Models for Navigation , 2015, COSIT.

[6]  Michael A. Goodrich,et al.  Adverb Palette: GUI-based support for human interaction in multi-objective path-planning , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Karl Iagnemma,et al.  Stochastic mobility-based path planning in uncertain environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  F. Leisch.  FlexMix: A general framework for finite mixture models and latent class regression in R , 2004 .

[9]  Brian Scassellati,et al.  Robot Nonverbal Communication as an AI Problem (and Solution) , 2015, AAAI Fall Symposia.

[10]  Cornelius Hagen,et al.  Preferred and Alternative Mental Models in Spatial Reasoning , 2005, Spatial Cogn. Comput..

[11]  Christopher W. Myers,et al.  Visual Search and Target Selection Using a Bounded Optimal Model of State Estimation & Control , 2015 .

[12]  Kenneth M. Dawson-Howe,et al.  The detection of buried landmines using probing robots , 1998, Robotics Auton. Syst..

[13]  Kristin E. Schaefer,et al.  Will passengers trust driverless vehicles? Removing the steering wheel and pedals , 2016, 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[14]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[15]  Eric Feron,et al.  Trajectory Clustering and an Application to Airspace Monitoring , 2011, IEEE Trans. Intell. Transp. Syst..

[16]  Thomas A. Farmer,et al.  Hand in Motion Reveals Mind in Motion , 2011, Front. Psychology.

[17]  Xiaobo Tan,et al.  A Stochastic Algorithm for Self-Organization of Autonomous Swarms , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[18]  A. W. Evans,et al.  Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue , 2017, ArXiv.

[19]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[20]  Shane T. Mueller,et al.  Examining Memory for Search Using a Simulated Aerial Search and Rescue Task , 2013 .

[21]  Michael A. Goodrich,et al.  UAV intelligent path planning for Wilderness Search and Rescue , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  B. Kuipers,et al.  Robot Navigation with MPEPC in Dynamic and Uncertain Environments : From Theory to Practice , 2012 .

[23]  Florian Jentsch,et al.  From Tools to Teammates , 2011 .

[24]  James L. Szalma,et al.  A Meta-Analysis of Factors Influencing the Development of Trust in Automation: Implications for Human-Robot Interaction , 2014 .

[25]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[26]  Philippe Martinet,et al.  Model Predictive Control for Vehicle Guidance in Presence of Sliding: Application to Farm Vehicles Path Tracking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Stefan Wermter,et al.  A neural approach for robot navigation based on cognitive map learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[28]  Jessie Y. C. Chen,et al.  Situation awareness-based agent transparency and human-autonomy teaming effectiveness , 2018 .

[29]  Friedrich Leisch,et al.  Fitting finite mixtures of generalized linear regressions in R , 2007, Comput. Stat. Data Anal..

[30]  Lin Sun,et al.  Real-Time Detection of Anomalous Taxi Trajectories from GPS Traces , 2011, MobiQuitous.

[31]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[32]  E. W. Justh,et al.  A Simple Control Law for UAV Formation Flying , 2002 .

[33]  Riccardo Cassinis.  Landmines Detection Methods Using Swarms of Simple Robots , 2000 .

[34]  James C. Boerkoel,et al.  Planning for Flexible Human-Robot Co-navigation in Dynamic Manufacturing Environments , 2013 .

[35]  Jason S. Metcalfe,et al.  Field testing of tele-operation versus shared and traded control for military assets: an evaluation involving real-time embedded simulation and soldier assessment , 2010, Defense + Commercial Sensing.

[36]  Howie Choset,et al.  Parameterized and Scripted Gaits for Modular Snake Robots , 2009, Adv. Robotics.

[37]  Sara B. Kiesler,et al.  Human Mental Models of Humanoid Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[38]  Kristin E. Schaefer,et al.  Relinquishing Manual Control: Collaboration Requires the Capability to Understand Robot Intent , 2016, 2016 International Conference on Collaboration Technologies and Systems (CTS).

[39]  John S. Bay,et al.  Toward the development of a material transport system using swarms of ant-like robots , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[40]  Brandon S. Perelman,et al.  A naturalistic computational model of human behavior in navigation and search tasks , 2015 .

[41]  Shane T. Mueller,et al.  Identifying Mental Models of Search in a Simulated Flight Task Using a Pathmapping Approach , 2015 .

[42]  Luis Montesano,et al.  Lessons Learned in Integration for Sensor-Based Robot Navigation Systems , 2006 .

[43]  David R. Traum,et al.  Assessing Agreement in Human-Robot Dialogue Strategies: A Tale of Two Wizards , 2016, IVA.

[44]  Longin Jan Latecki,et al.  Shape Similarity Measure Based on Correspondence of Visual Parts , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Javier Minguez,et al.  Integration of planning and reactive obstacle avoidance in autonomous sensor-based navigation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.