Interactive image segmentation based on superpixel grouping for mobile devices with touchscreen

This paper proposes a novel method for semi-supervised image segmentation that is particularly targeted for interaction on mobile devices with touchscreen. In order to extract an object from a complicated scene with minimal user input, superpixels are first grouped into overlapping regions based on their visual similarity and the groups belonging to the object are then selected via user scribbles. By moving the user interaction to the end of the whole process, users' idle time is minimized hence an engaging user experience is achieved. The proposed method can effortlessly handle imprecise and inaccurate scribbles and is inherently suitable for touchscreen devices since it eliminates the necessity of a separate brush for marking the background as majority of state-of-the-art methods do. A novel fine-tuning method is also proposed where both foreground and background corrections are possible without entailing the user to change the brush. Experimental results prove that successful results are achieved with a slick and pleasant user experience.

[1]  Jiang Wu,et al.  Interactive object extraction by merging regions with k-global maximal similarity , 2013, Neurocomputing.

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[5]  H. Barlow Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[6]  Kemal Ugur,et al.  Robust interactive segmentation via coloring , 2012, VIGTA '12.

[7]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Isabelle Herlin,et al.  Solving ill-posed Image Processing problems using Data Assimilation , 2011, Numerical Algorithms.

[10]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[12]  T. Kailath The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[13]  David Zhang,et al.  Automatic Image Segmentation by Dynamic Region Merging , 2010, IEEE Transactions on Image Processing.

[14]  Heung-Yeung Shum,et al.  Paint selection , 2009, SIGGRAPH 2009.