Highlighting objects of interest in an image by integrating saliency and depth

Stereo images have been captured primarily for 3D reconstruction in the past. However, the depth information acquired from stereo can also be used along with saliency to highlight certain objects in a scene. This approach can be used to make still images more interesting to look at, and highlight objects of interest in the scene. We introduce this novel direction in this paper, and discuss the theoretical framework behind the approach. Even though we use depth from stereo in this work, our approach is applicable to depth data acquired from any sensor modality. Experimental results on both indoor and outdoor scenes demonstrate the benefits of our algorithm.

[1]  B. Schölkopf,et al.  Graph-Based Visual Saliency , 2007 .

[2]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[3]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[4]  Lizhuang Ma,et al.  Saliency-based depth-of-field rendering with flash and non-flash pairs , 2014, VRCAI '14.

[5]  Ashutosh Saxena,et al.  Learning Depth from Single Monocular Images , 2005, NIPS.

[6]  Anup Basu,et al.  Enhancing videoconferencing using spatially varying sensing , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Ashutosh Saxena,et al.  Make3D: Learning 3D Scene Structure from a Single Still Image , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sungkil Lee,et al.  Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  A. Basu,et al.  Airway Segmentation and Measurement in CT Images , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Jing Wang,et al.  Depth-of-Field Rendering with Saliency-Based Bilateral Filtering , 2013, 2013 International Conference on Computer-Aided Design and Computer Graphics.

[12]  Anup Basu,et al.  Prioritized region of interest coding in JPEG2000 , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Anup Basu,et al.  A Hybrid Knowledge-Guided Detection Technique for Screening of Infectious Pulmonary Tuberculosis From Chest Radiographs , 2010, IEEE Transactions on Biomedical Engineering.

[14]  Lijun Yin,et al.  Nose shape estimation and tracking for model-based coding , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[15]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[16]  Irene Cheng,et al.  Foveated online 3D visualization , 2002, Object recognition supported by user interaction for service robots.

[17]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[18]  Anup Basu,et al.  QoS based video delivery with foveation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[19]  Lijun Yin,et al.  Integrating active face tracking with model based coding , 1999, Pattern Recognit. Lett..

[20]  Anup Basu,et al.  Modeling fish-eye lenses , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[21]  Lijun Yin,et al.  Eye tracking and animation for MPEG-4 coding , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  Anup Basu,et al.  Variable resolution teleconferencing , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[23]  Hung-Kuo Chu,et al.  Refocusing images captured from a stereoscopic camera , 2013, SIGGRAPH '13.

[24]  Qiaosong Wang,et al.  Stereo vision–based depth of field rendering on a mobile device , 2014, J. Electronic Imaging.

[25]  Cheng Xiang,et al.  Scalable scene understanding using saliency-guided object localization , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).