Occluded Object Motion Estimation System based on Particle Filter with 3D Reconstruction

This paper presents a method for occluded object based motion estimation and tracking system in dynamic image sequences using particle filter with 3D reconstruction. A unique characteristic of this study is its ability to cope with partial occlusion based continuous motion estimation using particle filter inspired from the mirror neuron system in human brain. To update a prior knowledge about the shape or motion of objects, firstly, fundamental 3D reconstruction based occlusion tracing method is applied and object landmarks are determined. And optical flow based motion vector is estimated from the movement of the landmarks. When arbitrary partial occlusions are occurred, the continuous motion of the hidden parts of object can be estimated by particle filter with optical flow. The resistance of the resulting estimation to partial occlusions enables the more accurate detection and handling of more severe occlusions.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[3]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[4]  Junheong Park,et al.  Occluded Object Motion Tracking Method based on Combination of 3D Reconstruction and Optical Flow Estimation , 2011 .

[5]  Yong-Nyuo Shin.  Implementation Privacy Reference Architecture for Forensic Readiness , 2012, Int. J. Fuzzy Log. Intell. Syst..

[6]  Arnold W. M. Smeulders,et al.  Fast occluded object tracking by a robust appearance filter , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[8]  Quan Pan,et al.  Real-time multiple objects tracking with occlusion handling in dynamic scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[10]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[11]  P. J. Hargrave,et al.  A tutorial introduction to Kalman filtering , 1989 .

[12]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Dan Schonfeld,et al.  A complete system for head tracking using motion-based particle filter and randomly perturbed active contour , 2005, IS&T/SPIE Electronic Imaging.

[14]  Kwang-Eun Ko,et al.  Specified Object Tracking in an Environment of Multiple Moving Objects using Particle Filter , 2011 .

[15]  Junchul Chun,et al.  Realtime Facial Expression Recognition from Video Sequences Using Optical Flow and Expression HMM , 2009 .