Multi Camera Visual Saliency Using Image Stitching

This paper presents and investigates two models for a multi camera configuration with visual saliency capability. Applications in various imaging fields each have a different set of detection parameters and requirements which would result in the necessity of software changes. The visual saliency capability offered by this multi camera model allows generic detection of conspicuous objects be it human or non- human based on simple low level features. As multiple cameras are used, an image stitching technique is employed to allow combination of Field-of-View (FoV) from different camera captures to provide a panoramic detection field. The stitching technique is also used to complement the visual saliency model in this work. In the first model, image stitching is applied to individual captures to provide a wider FoV, whereby the visual saliency algorithm would able to operate on a wide area. For the second model, visual saliency is applied to individual captures. Then, the maps are recombined based on a set of stitching parameters to reinforced salient features present in objects at the FoV overlap regions. Simulations of the two models are conducted and demonstrated for performance evaluation.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  Kah Phooi Seng,et al.  Performance evaluation of feature detection in using subsampled images for image stitching , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[3]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[4]  Piotr Ostiak Implementation of HDR panorama stitching algorithm , 2006 .

[5]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[6]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Alice Caplier,et al.  Using Human Visual System modeling for bio-inspired low level image processing , 2010, Comput. Vis. Image Underst..

[8]  Ming Liu,et al.  Robust Multi-View Multi-Camera Face Detection inside Smart Rooms Using Spatio-Temporal Dynamic Programming , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[9]  Thierry Baccino,et al.  Medium Spatial Frequencies, a Strong Predictor of Salience , 2011, Cognitive Computation.

[10]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[11]  P. Petrov,et al.  Face detection and tracking with an active camera , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  George Mather,et al.  Foundations of Perception , 2006 .

[14]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[15]  Sergio A. Velastin,et al.  How close are we to solving the problem of automated visual surveillance? , 2008, Machine Vision and Applications.