Foreground detection using loopy belief propagation

This paper develops a simple and effective method for detection of sows and piglets in grayscale video recordings of farrowing pens. This approach consists of three stages: background updating, calculation of pseudo-wavelet coefficients and foreground object segmentation. In the first stage, the texture integration is used to update the background modelling (i.e. the reference image). In the second stage, we apply an “a trous” wavelet transform on the current reference image and then perform subtraction between the current original image and the approximation of the current reference image. In the third stage, the pairwise relationships between a pixel and its neighbours on a factor graph are modelled based on the pseudo-wavelet coefficients, and the image probabilities are approximated by using loopy belief propagation. Experiments have shown promising results in extracting foreground objects from complex farrowing pen scenes, such as sudden light changes and dynamic background as well as motionless foreground objects.

[1]  Michael Vinther,et al.  Validation of a digital video tracking system for recording pig locomotor behaviour , 2005, Journal of Neuroscience Methods.

[2]  Andrew C. Singer,et al.  Image segmentation using factor graphs , 2003, IEEE Workshop on Statistical Signal Processing, 2003.

[3]  S. Mallat A wavelet tour of signal processing , 1998 .

[4]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[5]  R. D. Tillett,et al.  Image analysis for agricultural processes: a review of potential opportunities , 1991 .

[6]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[7]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[8]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[9]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[10]  Robert T. Collins,et al.  Belief Propagation in a 3D Spatio-temporal MRF for Moving Object Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Ferdinand van der Heijden,et al.  Recursive unsupervised learning of finite mixture models , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  V. Gómez,et al.  An automatic colour-based computer vision algorithm for tracking the position of piglets , 2009 .

[13]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Petra Perner,et al.  Motion Tracking of Animals for Behavior Analysis , 2001, IWVF.

[15]  Ramesh C. Jain,et al.  Illumination independent change detection for real world image sequences , 1989, Comput. Vis. Graph. Image Process..

[16]  J Hu,et al.  Image-processing algorithms for behavior analysis of group-housed pigs , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[17]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[18]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[19]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[20]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[21]  J. A. Marchant,et al.  Extending the snake image processing algorithm for outlining pigs in scenes , 1993 .

[22]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..

[23]  Torben Gregersen,et al.  Original papers: Development of a real-time computer vision system for tracking loose-housed pigs , 2011 .

[24]  R. D. Tillett,et al.  Using model-based image processing to track animal movements , 1997 .

[25]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[26]  Hongwei Xin,et al.  A real-time computer vision assessment and control of thermal comfort for group-housed pigs , 2008 .