Tuner: Principled Parameter Finding for Image Segmentation Algorithms Using Visual Response Surface Exploration

In this paper we address the difficult problem of parameter-finding in image segmentation. We replace a tedious manual process that is often based on guess-work and luck by a principled approach that systematically explores the parameter space. Our core idea is the following two-stage technique: We start with a sparse sampling of the parameter space and apply a statistical model to estimate the response of the segmentation algorithm. The statistical model incorporates a model of uncertainty of the estimation which we use in conjunction with the actual estimate in (visually) guiding the user towards areas that need refinement by placing additional sample points. In the second stage the user navigates through the parameter space in order to determine areas where the response value (goodness of segmentation) is high. In our exploration we rely on existing ground-truth images in order to evaluate the "goodness" of an image segmentation technique. We evaluate its usefulness by demonstrating this technique on two image segmentation algorithms: a three parameter model to detect microtubules in electron tomograms and an eight parameter model to identify functional regions in dynamic Positron Emission Tomography scans.

[1]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[2]  S. Griffis EDITOR , 1997, Journal of Navigation.

[3]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[4]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[5]  William J. Welch,et al.  Screening the Input Variables to a Computer Model Via Analysis of Variance and Visualization , 2006 .

[6]  Ghassan Hamarneh,et al.  Kinetic Modeling Based Probabilistic Segmentation for Molecular Images , 2008, MICCAI.

[7]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[8]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[9]  Suyash P. Awate,et al.  Adaptive Markov modeling for mutual-information-based, unsupervised MRI brain-tissue classification , 2006, Medical Image Anal..

[10]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[11]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[12]  Cláudio T. Silva,et al.  Querying and Creating Visualizations by Analogy , 2007, IEEE Transactions on Visualization and Computer Graphics.

[13]  Pat Hanrahan,et al.  An Extension of Wilkinson’s Algorithm for Positioning Tick Labels on Axes , 2010, IEEE Transactions on Visualization and Computer Graphics.

[14]  Kwan-Liu Ma,et al.  A spreadsheet interface for visualization exploration , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[15]  Adam Finkelstein,et al.  Where do people draw lines , 2008, SIGGRAPH 2008.

[16]  Peter Filzmoser,et al.  Uncertainty‐Aware Exploration of Continuous Parameter Spaces Using Multivariate Prediction , 2011, Comput. Graph. Forum.

[17]  Peng Zhao,et al.  Stagewise Lasso , 2007, J. Mach. Learn. Res..

[18]  J. V. van Wijk,et al.  HyperSlice: visualization of scalar functions of many variables , 1993, VIS '93.

[19]  Wolfgang Berger,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2010 Hypermoval: Interactive Visual Validation of Regression Models for Real-time Simulation , 2022 .

[20]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Wolfgang Berger,et al.  Interactive visual analysis of multiobjective optimizations , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[22]  J. Sacks,et al.  Artic sea ice variability: Model sensitivities and a multidecadal simulation , 1994 .

[23]  Kaisa Miettinen,et al.  NAUTILUS method: An interactive technique in multiobjective optimization based on the nadir point , 2010, Eur. J. Oper. Res..

[24]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[25]  G. Box,et al.  On the Experimental Attainment of Optimum Conditions , 1951 .

[26]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[27]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Ghassan Hamarneh,et al.  Optimal Weights for Convex Functionals in Medical Image Segmentation , 2009, ISVC.

[29]  Kwan-Liu Ma,et al.  Image graphs-a novel approach to visual data exploration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[30]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[31]  Stefan Bruckner,et al.  Result-Driven Exploration of Simulation Parameter Spaces for Visual Effects Design , 2010, IEEE Transactions on Visualization and Computer Graphics.

[32]  Roy A. Ruddle,et al.  Visualization of Parameter Space for Image Analysis , 2011, IEEE Transactions on Visualization and Computer Graphics.

[33]  Jarke J. van Wijk,et al.  HyperSlice - Visualization of Scalar Functions of Many Variables , 1993, IEEE Visualization.

[34]  P. Gács,et al.  Algorithms , 1992 .

[35]  D. Kriegman,et al.  Automatic particle selection: results of a comparative study. , 2004, Journal of structural biology.

[36]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[37]  Daniel Weiskopf,et al.  Continuous Scatterplots , 2008, IEEE Transactions on Visualization and Computer Graphics.

[38]  James O. Berger,et al.  Using Statistical and Computer Models to Quantify Volcanic Hazards , 2009, Technometrics.

[39]  Nando de Freitas,et al.  A Bayesian interactive optimization approach to procedural animation design , 2010, SCA '10.

[40]  Ghassan Hamarneh,et al.  Is a Single Energy Functional Sufficient? Adaptive Energy Functionals and Automatic Initialization , 2007, MICCAI.

[41]  Amar Mitiche,et al.  Variational and Level Set Methods in Image Segmentation , 2010 .

[42]  Eduard Gröller,et al.  World Lines , 2010, IEEE Transactions on Visualization and Computer Graphics.

[43]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.

[44]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Issei Fujishiro,et al.  The elements of graphing data , 2005, The Visual Computer.

[46]  William J. Welch,et al.  Parameter space exploration of an ocean general circulation model using an isopycnal mixing parameterization , 1994 .

[47]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[48]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Matthew O. Ward,et al.  XmdvTool: integrating multiple methods for visualizing multivariate data , 1994, Proceedings Visualization '94.