Real-time illumination-invariant motion detection in spatio-temporal image volumes

An algorithm for robust motion detection in video is proposed in this work. The algorithm continuously analyses the dense pixel volume formed by the current frame and its nearest neighbours in time. By assuming continuity of motion in space and time, pixels on slanted edges in this timespace pixel volume are considered to be in motion. This is in contrast to prevailing foreground-background models used for motion detection that consider a pixel's history in aggregation. By using an efficient data reduction scheme and leveraging logical bit-parallel operations of current CPUs, real-time performance is achieved even on resource-scarce embedded devices. Video surveillance applications demand for efficient algorithms which robustly detect motion across a wide variety of conditions without the need for on-site parameter adjustments. Experiments with real-world video show robust motion detection results with the proposed method, especially under conditions normally considered difficult, such as continuously changing illumination.

[1]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[4]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Joachim Weickert,et al.  Towards ultimate motion estimation: combining highest accuracy with real-time performance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Jin Hyeong Park,et al.  Performance evaluation of object detection algorithms , 2002, Object recognition supported by user interaction for service robots.

[8]  Hassane Essafi,et al.  Spatio-Temporal Video Slice Edges Analysis for Shot Transition Detection and Classification , 2007 .

[9]  I. Gu,et al.  Analysing Video Sequences using the Spatio-temporal Volume , 2004 .