Modeling Human Guidance Behavior Based on Patterns in Agent–Environment Interactions

This paper presents the foundations for the analysis and modeling of human guidance behavior that is based on the emergent patterns in the closed-loop agent-environment dynamics. The central hypothesis is that these patterns, which can be explained in terms of invariants inherent to the closed-loop dynamics, provide the building blocks for the organization of human guidance behavior. The concept of interaction patterns is first introduced using a toy example and then detailed formally using dynamical system and control principles. This paper then demonstrates the existence and significance of interaction patterns in human guidance behavior that is based on data collected using guidance experiments with a miniature helicopter. The results confirm that human guidance behavior indeed exhibits invariances as defined by interaction patterns. The trajectories that are associated with each interaction pattern are then further decomposed by applying piecewise linear identification. The resulting elements are then combined under a hierarchical model that provides a natural and formal description of human guidance behavior.

[1]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[2]  R. Downs,et al.  Cognitive Maps and Spatial Behaviour: Process and Products , 2011 .

[3]  Magnus Egerstedt.  Some complexity aspects of the control of mobile robots , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[4]  F. A. Mussa-lvaldi,et al.  Convergent force fields organized in the frog's spinal cord , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Birsen Donmez,et al.  Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[7]  Adam Binch,et al.  Perception as Bayesian Inference , 2014 .

[8]  W. H. Warren.  The dynamics of perception and action. , 2006, Psychological review.

[9]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[10]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[11]  Bernard Mettler,et al.  Agile autonomous guidance using spatial value functions , 2010 .

[12]  James P. Crutchfield,et al.  Computational Mechanics: Pattern and Prediction, Structure and Simplicity , 1999, ArXiv.

[13]  Magnus Egerstedt,et al.  What Are the Ants Doing? Vision-Based Tracking and Reconstruction of Control Programs , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  J. Gibson,et al.  A theoretical field-analysis of automobile-driving , 1938 .

[15]  Antonio Bicchi,et al.  Symbolic planning and control of robot motion [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[16]  David N. Lee.  Guiding Movement by Coupling Taus , 1998 .

[17]  Ezra S. Krendel,et al.  Mathematical Models of Human Pilot Behavior , 1974 .

[18]  Richard M. Murray,et al.  Discriminating External and Internal Causes for Heading Changes in Freely Flying Drosophila , 2013, PLoS Comput. Biol..

[19]  Roger W. Brockett,et al.  On the computer control of movement , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[20]  Ellen J. Bass,et al.  Using Formal Verification to Evaluate Human-Automation Interaction: A Review , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[22]  Magnus Egerstedt,et al.  Autonomous driving in urban environments: approaches, lessons and challenges , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[23]  Zhaodan Kong,et al.  Mapping and Analysis of Human Guidance Performance From Trajectory Ensembles , 2013, IEEE Transactions on Human-Machine Systems.

[24]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[25]  Jean-Paul Laumond,et al.  The formation of trajectories during goal‐oriented locomotion in humans. II. A maximum smoothness model , 2007, The European journal of neuroscience.

[26]  Munther A. Dahleh,et al.  Maneuver-based motion planning for nonlinear systems with symmetries , 2005, IEEE Transactions on Robotics.

[27]  Marion A. Eppler,et al.  Development of Visually Guided Locomotion , 1998 .

[28]  Leslie Pack Kaelbling,et al.  A Dynamical Model of Visually-Guided Steering, Obstacle Avoidance, and Route Selection , 2003, International Journal of Computer Vision.

[29]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[30]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[31]  Zhaodan Kong,et al.  Research Infrastructure for Interactive Human- and Autonomous Guidance , 2013, J. Intell. Robotic Syst..

[32]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[33]  Zhaodan Kong,et al.  Foundations of formal language for humans and artificial systems based on intrinsic structure in spatial behavior , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  B. Mettler,et al.  Cognitive Critique Volume 3 STRUCTURE AND ORGANIZATIONAL PRINCIPLES OF AGILE BEHAVIOR : CHALLENGES AND OPPORTUNITIES IN COGNITIVE ENGINEERING , 2011 .

[35]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[36]  David Mumford,et al.  Pattern Theory: the Mathematics of Perception , 2002, math/0212400.

[37]  Douglas Lind,et al.  An Introduction to Symbolic Dynamics and Coding , 1995 .