Motion Saliency Maps from Spatiotemporal Filtering

For artificial systems acting and perceiving in a dynamic world a core ability is to focus on aspects of the environment that can be crucial for the task at hand. Perception in autonomous systems needs to be filtered by a biologically inspired selective ability, therefore attention in dynamic settings is becoming a key research issue. In this paper we present a model for motion salience map computation based on spatiotemporal filtering. We extract a measure of coherent motion energy and select by the center-surround mechanism relevant zones that accumulate most energy and therefore contrast with surroundings in a given time slot. The method was tested on synthetic and real video sequences, supporting biological plausibility.

[1]  P Cavanagh,et al.  Attention-based motion perception. , 1992, Science.

[2]  R. Rosenholtz A simple saliency model predicts a number of motion popout phenomena , 1999, Vision Research.

[3]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  John K. Tsotsos,et al.  Attending to visual motion , 2005, Comput. Vis. Image Underst..

[5]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[6]  T. Duckett VOCUS : A Visual Attention System for Object Detection and Goal-directed Search , 2010 .

[7]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[8]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[9]  Thierry Pun,et al.  Attentive mechanisms for dynamic and static scene analysis , 1995 .

[10]  Simone Frintrop,et al.  A Real-time Visual Attention System Using Integral Images , 2007, ICVS 2007.

[11]  Richard P. Wildes,et al.  Qualitative Spatiotemporal Analysis Using an Oriented Energy Representation , 2000, ECCV.

[12]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[13]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[14]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  S. Yantis,et al.  Visual motion and attentional capture , 1994, Perception & psychophysics.

[16]  Eero P. Simoncelli Local analysis of visual motion , 2003 .

[17]  Richard P. Wildes A measure of motion salience for surveillance applications , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  Subhransu Maji,et al.  Confidence Based updation of Motion Conspicuity in Dynamic Scenes , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[19]  Hyeran Byun,et al.  Salient human detection for robot vision , 2007, Pattern Analysis and Applications.

[20]  Christopher M. Bishop,et al.  Non-linear Bayesian Image Modelling , 2000, ECCV.