Tracking and Modeling of Human Activity Using Laser Rangefinders

We describe a system that uses laser rangefinders to track the positions of people in typical environments and then builds predictive models of the observed movement patterns and interactions between persons. We represent all human activity as detected by the laser rangefinder system as a probability distribution over the space of possible displacements. The assumption is that different activities will map to distinct probability distributions. Position tracks are first segmented and clustered into short sequences representing different activities. The sequence of activity clusters is then used to build a stochastic model of the observed movement patterns and the typical frequency of occurrence. Interactions are assumed to occur between persons whose corresponding probability distributions exhibit a high degree of similarity. We describe the performance of the system on data recorded from unscripted activities that occurred in different environments: open layout laboratory, corridor, and an outdoor courtyard. In the laboratory environment, the system was able to detect interactions between people (ping-pong players) without utilizing a pre-defined model of specific interactions. In the courtyard environment, the system was able to flag a sudden increase in the number of people in the courtyard as an anomalous occurrence without any pre-defined concept of occupancy of the environment.

[1]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[2]  Ajo Fod,et al.  Laser-Based People Tracking , 2002 .

[3]  Ryo Kurazume,et al.  Multi-Part People Detection Using 2D Range Data , 2010, Int. J. Soc. Robotics.

[4]  Gaurav S. Sukhatme,et al.  Detecting anomalous human interactions using laser range-finders , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Maja J. Mataric,et al.  Temporal occupancy grids: a method for classifying the spatio-temporal properties of the environment , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Ramakant Nevatia,et al.  Multi-agent event recognition , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Óscar Martínez Mozos,et al.  Multi-Layer People Detection using 2 D Range Data , 2009 .

[8]  Maja J. Mataric,et al.  General spatial features for analysis of multi-robot and human activities from raw position data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Wolfram Burgard,et al.  People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters , 2003, Int. J. Robotics Res..

[10]  Bernt Schiele,et al.  Visual People Detection - Different Models, Comparison and Discussion , 2009, ICRA 2009.

[11]  Svetha Venkatesh,et al.  Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Thomas Eiter,et al.  Where is ...? Learning and Utilizing Motion Patterns of Persons with Mobile Robots , 2003, IJCAI.

[13]  Wolfram Burgard,et al.  Multi-model Hypothesis Group Tracking and Group Size Estimation , 2010, Int. J. Soc. Robotics.

[14]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[15]  W. S. Lee,et al.  Motion Planning for People Tracking in Uncertain and Dynamic Environments , 2009 .

[16]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Gaurav S. Sukhatme,et al.  Semantic Mapping Using Mobile Robots , 2008, IEEE Transactions on Robotics.

[18]  Aaron F. Bobick,et al.  Video surveillance of interactions , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[19]  Maja J. Matarić,et al.  Augmented Markov Models , 1999 .

[20]  Geoffrey J. Gordon,et al.  Better Motion Prediction for People-tracking , 2004 .

[21]  P. Bernaola-Galván,et al.  Compositional segmentation and long-range fractal correlations in DNA sequences. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  Henry A. Kautz,et al.  Inferring High-Level Behavior from Low-Level Sensors , 2003, UbiComp.

[23]  Alex Pentland,et al.  Statistical Modeling of Human Interactions , 1998, CVPR 1998.

[24]  Aaron F. Bobick,et al.  Action recognition using probabilistic parsing , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  Dylan A. Shell,et al.  Estimation of Pedestrian Distribution in Indoor Environments using Multiple Pedestrian Tracking , 2009 .

[26]  James L. Crowley,et al.  Situation Models: A Tool for Observing and Understanding Activity , 2008, ICRA 2008.

[27]  Steven Lemm,et al.  A Dynamic HMM for On-line Segmentation of Sequential Data , 2001, NIPS.

[28]  Roland Siegwart,et al.  A Trained System for Multimodal Perception in Urban Environments , 2009 .

[29]  Ramakant Nevatia,et al.  Representation and optimal recognition of human activities , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  Oliver Brdiczka,et al.  Learning Situation Models in a Smart Home , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Xuan Song,et al.  Tracking interacting targets with laser scanner via on-line supervised learning , 2008, 2008 IEEE International Conference on Robotics and Automation.

[32]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[33]  Henry A. Kautz,et al.  Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields , 2007, Int. J. Robotics Res..

[34]  Gaurav S. Sukhatme,et al.  Data Segmentation for Region Detection in a Sensor Network , 2005 .

[35]  Marcelo H. Ang,et al.  Motion Strategies for People Tracking in Cluttered and Dynamic Environments , 2008, ISER.

[36]  Simone Frintrop,et al.  Visual Person Tracking Using a Cognitive Observation Model , 2009 .

[37]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Wolfram Burgard,et al.  Classifying dynamic objects , 2009, Auton. Robots.

[39]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[40]  Gaurav S. Sukhatme,et al.  Relaxation on a mesh: a formalism for generalized localization , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[41]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[42]  R. Siegwart,et al.  Proceedings of the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems , 2002 .

[43]  Kai O. Arras,et al.  Spatially Grounded Multi-Hypothesis Tracking of People , 2009 .

[44]  Hiroshi Ishiguro,et al.  Laser-Based Tracking of Human Position and Orientation Using Parametric Shape Modeling , 2009, Adv. Robotics.

[45]  Wolfram Burgard,et al.  Learning motion patterns of persons for mobile service robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).