How Multirobot Systems Research will Accelerate our Understanding of Social Animal Behavior

Our understanding of social insect behavior has significantly influenced artificial intelligence (AI) and multirobot systems' research (e.g., ant algorithms and swarm robotics). In this work, however, we focus on the opposite question: "How can multirobot systems research contribute to the understanding of social animal behavior?" As we show, we are able to contribute at several levels. First, using algorithms that originated in the robotics community, we can track animals under observation to provide essential quantitative data for animal behavior research. Second, by developing and applying algorithms originating in speech recognition and computer vision, we can automatically label the behavior of animals under observation. In some cases the automatic labeling is more accurate and consistent than manual behavior identification. Our ultimate goal, however, is to automatically create, from observation, executable models of behavior. An executable model is a control program for an agent that can run in simulation (or on a robot). The representation for these executable models is drawn from research in multirobot systems programming. In this paper we present the algorithms we have developed for tracking, recognizing, and learning models of social animal behavior, details of their implementation, and quantitative experimental results using them to study social insects

[1]  Manuela Veloso,et al.  Automated Robot Behavior Recognition Applied to Robotic Soccer , 1999 .

[2]  Alex Pentland,et al.  Task-Specific Gesture Analysis in Real-Time Using Interpolated Views , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Tucker Balch,et al.  An outdoor 3-D visual tracking system for the study of spatial navigation and memory in rhesus monkeys , 2005, Behavior research methods.

[5]  Ajo Fod,et al.  Laser-Based People Tracking , 2002 .

[6]  Milind Tambe,et al.  Tracking Dynamic Team Activity , 1996, AAAI/IAAI, Vol. 1.

[7]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[8]  Frank Dellaert,et al.  Efficient particle filter-based tracking of multiple interacting targets using an MRF-based motion model , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  James M. Rehg,et al.  Data-Driven MCMC for Learning and Inference in Switching Linear Dynamic Systems , 2005, AAAI.

[10]  Frank Dellaert,et al.  Improving Multirobot Multitarget Tracking by Communicating Negative Information , 2005 .

[11]  Lynne E. Parker,et al.  Distributed Algorithms for Multi-Robot Observation of Multiple Moving Targets , 2002, Auton. Robots.

[12]  David C. Hogg,et al.  The acquisition and use of interaction behaviour models , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[13]  Deborah M. Gordon.  The organization of work in social insect colonies , 2002 .

[14]  Boris Ryabko,et al.  Using Shannon entropy and Kolmogorov complexity to study the communicative system and cognitive capacities in ants , 1996, Complex..

[15]  Tucker R. Balch,et al.  Representing Honey Bee Behavior for Recognition Using Human Trainable Models , 2004, Adapt. Behav..

[16]  Manuela M. Veloso,et al.  Automatically tracking and analyzing the behavior of live insect colonies , 2001, AGENTS '01.

[17]  Donald Reid.  An algorithm for tracking multiple targets , 1978 .

[18]  Gordon Cheng,et al.  Humanoid robot learning and game playing using PC-based vision , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Yoshua Bengio,et al.  Markovian Models for Sequential Data , 2004 .

[20]  Tucker R. Balch,et al.  Distributed sensor fusion for object position estimation by multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[21]  W. Schleidt,et al.  A Proposal for a Standard Ethogram, Exemplified by an Ethogram of the Bluebreasted Quail (Coturnix chinensis) , 1984 .

[22]  D HagerGregory,et al.  Probabilistic Data Association Methods for Tracking Complex Visual Objects , 2001 .

[23]  Edmund H. Durfee,et al.  Observational Uncertainty in Plan Recognition Among Interacting Robots , 1993 .

[24]  B. Webb.  What does robotics offer animal behaviour? , 2000, Animal Behaviour.

[25]  Y. Lacasse,et al.  From the authors , 2005, European Respiratory Journal.

[26]  Gregory D. Hager,et al.  Probabilistic Data Association Methods for Tracking Complex Visual Objects , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[28]  Manuela M. Veloso,et al.  Fast and inexpensive color image segmentation for interactive robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[29]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  S. Pratt.  Quorum sensing by encounter rates in the ant Temnothorax albipennis , 2005 .

[31]  R. Matthews,et al.  Ants. , 1898, Science.

[32]  Gaurav S. Sukhatme,et al.  Detecting anomalous human interactions using laser range-finders , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[33]  Ingemar J. Cox,et al.  Modeling a Dynamic Environment Using a Bayesian Multiple Hypothesis Approach , 1994, Artif. Intell..

[34]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[35]  S. Pratt,et al.  A modelling framework for understanding social insect foraging , 2003, Behavioral Ecology and Sociobiology.

[36]  B. Webb,et al.  Can robots make good models of biological behaviour? , 2001, Behavioral and Brain Sciences.

[37]  Aaron F. Bobick,et al.  Recognition of multi-agent interaction in video surveillance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Eamonn B. Mallon,et al.  Quorum sensing, recruitment, and collective decision-making during colony emigration by the ant Leptothorax albipennis , 2002, Behavioral Ecology and Sociobiology.

[39]  D. Gordon.  The organization of work in social insect colonies , 1996, Nature.

[40]  D. Gordon.  The Organization of Work in Social Insect , 2003 .

[41]  I D Couzin,et al.  Self-organized lane formation and optimized traffic flow in army ants , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[42]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[43]  Bernhard Schölkopf,et al.  On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion , 1998, Algorithmica.

[44]  D. Gordon,et al.  What is the function of encounter patterns in ant colonies? , 1993, Animal Behaviour.

[45]  Wolfram Burgard,et al.  Tracking multiple moving targets with a mobile robot using particle filters and statistical data association , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[46]  Sanjeev Khanna,et al.  Target tracking with distributed sensors: The focus of attention problem , 2005, Comput. Vis. Image Underst..

[47]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[48]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[49]  Magnus Egerstedt,et al.  What Are the Ants Doing? Vision-Based Tracking and Reconstruction of Control Programs , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[50]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[51]  Rachid Deriche,et al.  Tracking line segments , 1990, Image Vis. Comput..

[52]  Steven Skiena,et al.  Decision trees for geometric models , 1998, Int. J. Comput. Geom. Appl..

[53]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  E. Wilson,et al.  Caste and ecology in the social insects. , 1979, Monographs in population biology.