Human Motion Change Detection by Hierarchical Gaussian Process Dynamical Model with Particle Filter

Human motion change detection is a challenging taskfor a surveillance sensor system. Major challenges includecomplex scenes with a large amount of targets and confusors,and complex motion behaviors of different human objects.Human motion change detection and understandinghave been intensively studied over the past decades. In thispaper, we present a Hierarchical Gaussian Process DynamicalModel (HGPDM) integrated with particle filter trackerfor humanmotion change detection. Firstly, the high dimensionalhuman motion trajectory training data is projected tothe low dimensional latent space with a two-layer hierarchy.The latent space at the leaf node in bottom layer representsa typical humanmotion trajectory, while the root node in theupper layer controls the interaction and switching amongleaf nodes. The trained HGPDM will then be used to classifytest object trajectories which are captured by the particlefilter tracker. If the motion trajectory is different fromthe motion in the previous frame, the root node will transferthe motion trajectory to the corresponding leaf node. Inaddition, HGPDM can be used to predict the next motionstate, and provide Gaussian process dynamical samples forthe particle filter framework. The experiment results indicatethat our framework can accurately track and detect thehuman motion changes despite of complex motion and occlusion.In addition, the sampling in the hierarchical latentspace has greatly improved the efficiency of the particle filterframework.

[1]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gang Wang,et al.  Application partitioning on programmable platforms using the ant colony optimization , 2006, J. Embed. Comput..

[3]  Aaron F. Bobick,et al.  Recognition of multi-agent interaction in video surveillance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[5]  Neil A. Thacker,et al.  Real-time Body Tracking Using a Gaussian Process Latent Variable Model , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[7]  M WangJack,et al.  Gaussian Process Dynamical Models for Human Motion , 2008 .

[8]  Neil D. Lawrence,et al.  Hierarchical Gaussian process latent variable models , 2007, ICML '07.

[9]  Frank Vahid,et al.  Extending the Kernighan/Lin Heuristic for Hardware and Software Functional Partitioning , 1997, Des. Autom. Embed. Syst..

[10]  P. S. Sastry,et al.  Abnormal activity detection in video sequences using learnt probability densities , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[11]  Petru Eles,et al.  System Level Hardware/Software Partitioning Based on Simulated Annealing and Tabu Search , 1997, Des. Autom. Embed. Syst..

[12]  Seongsoo Hong Special issue: Real-Time and Embedded Computing Systems , 2005, J. Embed. Comput..

[13]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[14]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Theerayod Wiangtong,et al.  Comparing Three Heuristic Search Methods for Functional Partitioning in Hardware–Software Codesign , 2002, Des. Autom. Embed. Syst..

[16]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[18]  S. Beaty Genetic Algorithms versus Tabu Search for Instruction Scheduling , 1993 .

[19]  Frode Eika Sandnes,et al.  A new strategy for multiprocessor scheduling of cyclic task graphs , 2005, Int. J. High Perform. Comput. Netw..

[20]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Martin A. Riedmiller,et al.  RPROP - A Fast Adaptive Learning Algorithm , 1992 .

[22]  Shaogang Gong,et al.  VIGOUR: a system for tracking and recognition of multiple people and their activities , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  Jean Jyh-Jiun Shann,et al.  ETAHM: An energy-aware task allocation algorithm for heterogeneous multiprocessor , 2008, 2008 45th ACM/IEEE Design Automation Conference.

[24]  Ehud Rivlin,et al.  Using Gaussian Process Annealing Particle Filter for 3D Human Tracking , 2008, EURASIP J. Adv. Signal Process..

[25]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[27]  K. Mani Chandy,et al.  A comparison of list schedules for parallel processing systems , 1974, Commun. ACM.

[28]  Kent Wilken,et al.  Optimal instruction scheduling using integer programming , 2000, PLDI.

[29]  Mitsuhisa Sato,et al.  OpenMP: parallel programming API for shared memory multiprocessors and on-chip multiprocessors , 2002, 15th International Symposium on System Synthesis, 2002..

[30]  Jean-Marc Odobez,et al.  Using particles to track varying numbers of interacting people , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  Wayne H. Wolf The future of multiprocessor systems-on-chips , 2004, Proceedings. 41st Design Automation Conference, 2004..

[32]  Niraj K. Jha,et al.  : a novel scheduling technique for control-flow intensive behavioral descriptions , 1997, ICCAD 1997.

[33]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[34]  Jose E. Moreira,et al.  On the implementation and effectiveness of autoscheduling for shared-memory multiprocessors , 1996 .

[35]  Milind Girkar,et al.  Automatic Extraction of Functional Parallelism from Ordinary Programs , 1992, IEEE Trans. Parallel Distributed Syst..

[36]  Nahum Kiryati,et al.  Real-time abnormal motion detection in surveillance video , 2008, 2008 19th International Conference on Pattern Recognition.

[37]  Peter Marwedel,et al.  An Algorithm for Hardware/Software Partitioning Using Mixed Integer Linear Programming , 1997, Des. Autom. Embed. Syst..

[38]  Martin Grajcar Genetic list scheduling algorithm for scheduling and allocation on a loosely coupled heterogeneous multiprocessor system , 1999, DAC '99.

[39]  Pier Luca Lanzi,et al.  Ant colony optimization for mapping and scheduling in heterogeneous multiprocessor systems , 2008, 2008 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation.