GPU Sparse Ray-Traced Segmentation

This paper introduces a real-time region growing segmentation algorithm, designed for graphics processing units (GPUs), which labels only a fraction of the input elements. Instead of searching locally around each element for strong similarity, like state-of-the-art segmentation and pre-segmentation methods do, the proposed algorithm searches both locally and remotely, using a unique ray tracing-based search strategy, which quickly covers the segmentation search space. The presented algorithm fully exploits the parallelism of the GPUs, sparsely segmenting high-resolution images (4K) in real-time on low range laptops and other mobile devices, approximately $5\times $ times faster than the state-of-the-art simple linear iterative clustering (SLIC). While this paper demonstrates the results with images, the algorithm is trivially modifiable to work with input sets of any dimension. In contrast to the state-of-the-art real-time GPU methods, this algorithm doesn’t require additional merging steps, as pre-segmentation methods do, and it produces complete segmentation. Additionally, post-segmentation optional stages for complete labeling and region merging on the GPU are also provided, although they are not always necessary.

[1]  Joachim Denzler,et al.  GPU-Based Volume Segmentation , 2005 .

[2]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[3]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Babette Dellen,et al.  Real-Time Image Segmentation on a GPU , 2010, Facing the Multicore-Challenge.

[5]  Michael Mara,et al.  Efficient GPU Screen-Space Ray Tracing , 2014 .

[6]  Janito Vaqueiro Ferreira,et al.  Analysis of a Step-Based Watershed Algorithm Using CUDA , 2010, Int. J. Nat. Comput. Res..

[7]  Gregory D. Hager,et al.  Temporal Convolutional Networks for Action Segmentation and Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Joseph Ross Mitchell,et al.  A work-efficient GPU algorithm for level set segmentation , 2010, HPG '10.

[9]  Florica Moldoveanu,et al.  Time-consistent segmentation of indoor depth video frames , 2017, 2017 40th International Conference on Telecommunications and Signal Processing (TSP).

[10]  長井 歩 重み付きデータの Normalized Cuts , 2007 .

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ye Zhao,et al.  Parallel 3D Image Segmentation of Large Data Sets on a GPU Cluster , 2009, ISVC.

[13]  Zhengqin Li,et al.  Superpixel segmentation using Linear Spectral Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Li Li,et al.  Edge-based split-and-merge superpixel segmentation , 2015, 2015 IEEE International Conference on Information and Automation.

[16]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[17]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  P. J. Narayanan,et al.  CUDA cuts: Fast graph cuts on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Stefano Soatto,et al.  Really Quick Shift: Image Segmentation on a GPU , 2010, ECCV Workshops.

[20]  F. Moldoveanu,et al.  Image segmentation based on active contours without edges , 2012, 2012 IEEE 8th International Conference on Intelligent Computer Communication and Processing.

[21]  S. Natarajan An efficient Video Segmentation Algorithm with Real time Adaptive Threshold Technique , 2009 .

[22]  Leo Grady,et al.  Random walks based multi-image segmentation: Quasiconvexity results and GPU-based solutions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Adrian Hilton,et al.  Semantically Coherent Co-Segmentation and Reconstruction of Dynamic Scenes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[25]  Cordelia Schmid,et al.  Multi-fold MIL Training for Weakly Supervised Object Localization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jianfei Cai,et al.  Beyond pixels: A comprehensive survey from bottom-up to semantic image segmentation and cosegmentation , 2015, J. Vis. Commun. Image Represent..

[28]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[29]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Jan Kautz,et al.  Packet-based whitted and distribution ray tracing , 2007, GI '07.

[31]  Rhadamés Carmona,et al.  A volume segmentation approach based on GrabCut , 2013, CLEI Electron. J..

[32]  Sylvain Paris,et al.  Edge-Preserving Smoothing and Mean-Shift Segmentation of Video Streams , 2008, ECCV.

[33]  Jianbo Shi,et al.  Convolutional Random Walk Networks for Semantic Image Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Adrian Burlacu,et al.  Computer Vision for the Visually Impaired: the Sound of Vision System , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).