Human-Motion Saliency in Complex Scenes

We present a new and original method for human motion analysis and evaluation, developed on the basis of the role played by attention in the perception of human motion. Attention is particularly relevant both in a multi-motion scene and in social interactions, when it comes to select and discern why and what to focus on. The first crucial role of attention concerns the saliency of human motion within a scene where other dynamics might occur. The second role, in social-close interactions, is highlighted by the selectivity shown towards gesture modalities both in peripheral and central vision. Experiments for both modeling and testing have been based on a dynamic 3D gaze tracker.

[1]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  Richard P. Wildes,et al.  Qualitative Spatiotemporal Analysis Using an Oriented Energy Representation , 2000, ECCV.

[3]  Christopher M. Bishop,et al.  Non-linear Bayesian Image Modelling , 2000, ECCV.

[4]  P. Cavanagh,et al.  Position displacement, not velocity, is the cue to motion detection of second-order stimuli , 1998, Vision Research.

[5]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  Dennis Gabor,et al.  Theory of communication , 1946 .

[7]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[8]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[9]  Fiora Pirri,et al.  Eyes and Cameras Calibration for 3D World Gaze Detection , 2008, ICVS.

[10]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[11]  Alessandro Rudi,et al.  A general method for the point of regard estimation in 3D space , 2011, CVPR 2011.

[12]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[13]  L. Stelmach,et al.  Directed attention and perception of temporal order. , 1991, Journal of experimental psychology. Human perception and performance.

[14]  P. Cavanagh,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.5 The ‘when ’ pathway of the right parietal lobe , 2022 .

[15]  P. Cavanagh,et al.  Attention-based visual routines: sprites , 2001, Cognition.