Agent-Oriented Incremental Team and Activity Recognition

Monitoring team activity is beneficial when human teams cooperate in the enactment of a joint plan. Monitoring allows teams to maintain awareness of each other's progress within the plan and it enables anticipation of information needs. Humans find this difficult, particularly in time-stressed and uncertain environments. In this paper we introduce a probabilistic model, based on Conditional Random Fields, to automatically recognise the composition of teams and the team activities in relation to a plan. The team composition and activities are recognised incrementally by interpreting a stream of spatio-temporal observations.

[1]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[2]  Qiang Yang,et al.  Spatio-temporal event detection using dynamic conditional random fields , 2009, IJCAI 2009.

[3]  Henry A. Kautz,et al.  Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields , 2007, Int. J. Robotics Res..

[4]  Manuela M. Veloso,et al.  Feature selection for activity recognition in multi-robot domains , 2008, AAAI 2008.

[5]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[6]  Henry A. Kautz,et al.  Extracting Places and Activities from GPS Traces , 2005 .

[7]  Gita Reese Sukthankar,et al.  Robust recognition of physical team behaviors using spatio-temporal models , 2006, AAMAS '06.

[8]  Gita Sukthankar,et al.  A Model of Human Teamwork for Agent-Assisted Search Operations , 2008 .

[9]  Svetha Venkatesh,et al.  Recognizing and monitoring high-level behaviors in complex spatial environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Jane Yung-jen Hsu,et al.  Probabilistic models for concurrent chatting activity recognition , 2009, TIST.

[11]  J. Bobbin.  An incremental viterbi algorithm , 2007, ICMLA 2007.

[12]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[13]  Manuela M. Veloso,et al.  Conditional random fields for activity recognition , 2007, AAMAS '07.

[14]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[15]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.