StereoCut: Consistent interactive object selection in stereo image pairs

Methods of interacting with stereo image pairs are important for handling the increasing amount of stereoscopic 3D data now being produced. In this paper, we introduce a framework for interactively selecting objects in two stereo images simultaneously using graph cut. A key contribution of our method is the use of stereo correspondence probability distributions to govern the strength of the connection between the two images. This allows information from arbitrary stereo matching algorithms to be utilized by our method. We show how to enforce consistency in these distributions to improve the results. For comparisons, we introduce a new dataset of stereo images and ground truth selections. We evaluate different correspondence distributions and show that our method is effective in selecting objects from stereo pairs.

[1]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[2]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[3]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Larry S. Davis,et al.  Improved fast gauss transform and efficient kernel density estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Pieter Peers,et al.  SubEdit: a representation for editing measured heterogeneous subsurface scattering , 2009, SIGGRAPH 2009.

[7]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[9]  Scott Cohen,et al.  Geodesic graph cut for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Scott Cohen,et al.  LIVEcut: Learning-based interactive video segmentation by evaluation of multiple propagated cues , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Jong-Whan Jang,et al.  A new snake algorithm for object segmentation in stereo images , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[12]  Andrew Blake,et al.  Bi-layer segmentation of binocular stereo video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Hyeran Byun,et al.  Robust Object Segmentation Using Graph Cut with Object and Background Seed Estimation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Luc Van Gool,et al.  Transductive object cutout , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jiebo Luo,et al.  iCoseg: Interactive co-segmentation with intelligent scribble guidance , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Jian Sun,et al.  Video object cut and paste , 2005, SIGGRAPH 2005.

[17]  Guillermo Sapiro,et al.  Video SnapCut: robust video object cutout using localized classifiers , 2009, ACM Trans. Graph..

[18]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[19]  Matthias Zwicker,et al.  Stereoscopic 3D copy & paste , 2010, SIGGRAPH 2010.