Cognitively-Inspired Motion Pattern Learning & Analysis Algorithms for Higher-Level Fusion and Automated Scene Understanding

We have developed a suite of neurobiologically inspired algorithms for exploiting track data to learn normal patterns of motion behavior, detect deviations from normalcy, and predict future behavior. These capabilities contribute to higher-level fusion situational awareness and assessment objectives. They also provide essential elements for automated scene understanding to shift operator focus from sensor monitoring and activity detection to assessment and response. Our learning algorithms learn behavioral patterns at a variety of conceptual, spatial, and temporal levels to reduce a massive amount of track data to a rich set of information regarding their field of regard that supports decision-making and timely response initiation. Continuous incremental learning enables the models of normal behavior to adapt well to evolving situations while maintaining high levels of performance. Deviations from normalcy result in reports being published directly to operator displays or to other reasoning components within a larger system. Deviation tolerance levels are user settable during system operation to tune alerting sensitivity. Operator (or other system component) responses to anomaly alerts can be fed back into the algorithms to further enhance and refine learned models. These algorithms have been successfully demonstrated to learn vessel behaviors across the maritime domain and to learn vehicle and dismount behavior in land-based settings.

[1]  Bradley J. Rhodes,et al.  Taxonomic knowledge structure discovery from imagery-based data using the neural associative incremental learning (NAIL) algorithm , 2007, Inf. Fusion.

[2]  Allen M. Waxman,et al.  Associative Learning of Vessel Motion Patterns for Maritime Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[3]  B.J. Rhodes,et al.  Maritime situation monitoring and awareness using learning mechanisms , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[4]  Bradley J. Rhodes,et al.  Probabilistic associative learning of vessel motion patterns at multiple spatial scales for maritime situation awareness , 2007, 2007 10th International Conference on Information Fusion.

[5]  Allen M. Waxman,et al.  SeeCoast: persistent surveillance and automated scene understanding for ports and coastal areas , 2007, SPIE Defense + Commercial Sensing.

[6]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.