Modelling Competitive Behaviours by a hierarchical HMM architecture

Abstract- A decision making mechanism based on Hidden Markov Models (HMMs) was presented in the paper. This paper is concerned with the modelling of the behaviour of players operating in a competitive environment that is characterized by interactions amongst players or groups of players. Thus a new, on-line, hierarchical, probabilistic modelling architecture with a probabilistic decision tree was developed for the purpose of on-line behaviour recognition that accepts HMM behaviour probabilities of player and effectively segments their behaviour-with-time trajectories. This allows the location of important points in time where behaviour changes occur. Furthermore, the hierarchical nature of the system allows individual player classification results to be used towards the modelling and classification of higher-level tactical behaviours of groups of players, as defined within an application envelope. The system is applied in a relatively simple 2-D “air patrol” scenario and system simulation performance results are provided in terms of certain useful metrics.