Modeling motion patterns of dynamic objects by IOHMM

This paper presents a novel approach to model motion patterns of dynamic objects, such as people and vehicles, in the environment with the occupancy grid map representation. Corresponding to the ever-changing nature of the motion pattern of dynamic objects, we model each occupancy grid cell by an IOHMM, which is an inhomogeneous variant of the HMM. This distinguishes our work from existing methods which use the conventional HMM, assuming motion evolving according to a stationary process. By introducing observations of neighbor cells in the previous time step as input of IOHMM, the transition probabilities in our model are dependent on the occurrence of events in the cell's neighborhood. This enables our method to model the spatial correlation of dynamics across cells. A sequence processing example is used to illustrate the advantage of our model over conventional HMM based methods. Results from the experiments in an office corridor environment demonstrate that our method is capable of capturing dynamics of such human living environments.

[1]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[2]  Wolfram Burgard,et al.  Lifelong localization in changing environments , 2013, Int. J. Robotics Res..

[3]  Kai Oliver Arras,et al.  Place-dependent people tracking , 2011, Int. J. Robotics Res..

[4]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  Tom Duckett,et al.  Experimental Analysis of Sample-Based Maps for Long-Term SLAM , 2009, Int. J. Robotics Res..

[6]  Olivier Capp'e Online EM Algorithm for Hidden Markov Models , 2009, 0908.2359.

[7]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[8]  Jari Saarinen,et al.  Conditional transition maps: Learning motion patterns in dynamic environments , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Maja J. Mataric,et al.  Temporal occupancy grids: a method for classifying the spatio-temporal properties of the environment , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Jari Saarinen,et al.  Independent Markov chain occupancy grid maps for representation of dynamic environment , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  John J. Leonard,et al.  Dynamic pose graph SLAM: Long-term mapping in low dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Wolfram Burgard,et al.  Occupancy Grid Models for Robot Mapping in Changing Environments , 2012, AAAI.

[13]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[14]  Jari Saarinen,et al.  3D normal distributions transform occupancy maps: An efficient representation for mapping in dynamic environments , 2013, Int. J. Robotics Res..

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[16]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[17]  Yoshua Bengio,et al.  Markovian Models for Sequential Data , 2004 .

[18]  Harry Shum,et al.  Learning dynamic audio-visual mapping with input-output Hidden Markov models , 2006, IEEE Trans. Multim..