A Framework for Recognizing Multi-Agent Action from Visual Evidence

A probabilistic framework for representing and visually recognizing complex multi-agent action is presented. Motivated by work in model-based object recognition and designed for the recognition of action from visual evidence, the representation has three components: (1) temporal structure descriptions representing the temporal relationships between agent goals, (2) belief networks for probabilistic ally representing and recognizing individual agent goals from visual evidence, and (3) belief networks automatically generated from the temporal structure descriptions that support the recognition of the complex action. We describe our current work on recognizing American football plays from noisy trajectory data.

[1]  Tieniu Tan,et al.  Agent orientated annotation in model based visual surveillance , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[3]  J. Azarewicz,et al.  Template-based multi-agent plan recognition for tactical situation assessment , 1989, [1989] Proceedings. The Fifth Conference on Artificial Intelligence Applications.

[4]  H. Kollnig,et al.  The Association of Situation Graphs with Temporal Variations inImage , 1995 .

[5]  Edmund H. Durfee,et al.  Plan-based plan recognition models for the effective coordination of agents through observation , 1996 .

[6]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[7]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michael P. Wellman,et al.  Accounting for Context in Plan Recognition, with Application to Traffic Monitoring , 1995, UAI.

[9]  Ashwin Ram,et al.  Needles in a Haystack: Plan Recognition in Large Spatial Domains Involving Multiple Agents , 1998, AAAI/IAAI.

[10]  Jitendra Malik,et al.  Automatic Symbolic Traffic Scene Analysis Using Belief Networks , 1994, AAAI.

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[12]  Nir Friedman,et al.  Building Classifiers Using Bayesian Networks , 1996, AAAI/IAAI, Vol. 2.

[13]  H. Buxton,et al.  Advanced visual surveillance using Bayesian networks , 1997 .

[14]  Aaron F. Bobick,et al.  Closed-world tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Gudula Retz-Schmidt,et al.  A REPLAI of SOCCER: Recognizing Intentions in the Domain of Soccer Games , 1988, ECAI.

[16]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[17]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[18]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[19]  Milind Tambe,et al.  Tracking Dynamic Team Activity , 1996, AAAI/IAAI, Vol. 1.