Simultaneous detection and segmentation for generic objects

Numerous approaches to object detection and segmentation have been proposed so far. However, these methods are prone to fail in some general situations due to the proper object nature. For instance, classical approaches of object detection and segmentation obtain good results for some specific object classes (i.e. detection of pedestrians or segmentation of cars). However, these methods have troubles when detecting or segmenting object classes with different distinctive characteristics (i.e. cars and horses versus sky and road). In this paper, we propose a general framework to simultaneously perform object detection and segmentation on objects of different nature. Our approach is based on a boosting procedure which automatically decides - according to the object properties - whether is better to give more weight to the detection or segmentation process to improve both results. We validate our approach using different object classes from La-belMe, TUD and Weizmann databases, obtaining competitive detection and segmentation results.

[1]  Fátima de Lourdes dos Santos Nunes,et al.  Contrast Enhancement in Dense Breast Images to Aid Clustered Microcalcifications Detection , 2005, Journal of Digital Imaging.

[2]  Darrin C. Edwards,et al.  Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model. , 2002, Medical physics.

[3]  J. Starck,et al.  Astronomical Image and Data Analysis (Astronomy and Astrophysics Library) , 2006 .

[4]  Antonio Torralba,et al.  Object Detection and Localization Using Local and Global Features , 2006, Toward Category-Level Object Recognition.

[5]  Hongyan Du,et al.  Survival rates for breast cancers detected in a community service screening mammogram program. , 2006, American journal of surgery.

[6]  Maryellen L. Giger,et al.  Computerized Analysis of Mammographic Parenchymal Patterns on a Large Clinical Dataset of Full-Field Digital Mammograms: Robustness Study with Two High-Risk Datasets , 2012, Journal of Digital Imaging.

[7]  Xavier Carreras,et al.  A Simple Named Entity Extractor using AdaBoost , 2003, CoNLL.

[8]  C. Neubauer,et al.  Performance comparison of feature extraction methods for neural network based object recognition , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[9]  Ramón López de Mántaras,et al.  Fast and robust object segmentation with the Integral Linear Classifier , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Dimitrios I. Fotiadis,et al.  An automatic microcalcification detection system based on a hybrid neural network classifier , 2002, Artif. Intell. Medicine.

[11]  Wenyu Liu,et al.  Fan Shape Model for object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[13]  Nikhil R. Pal,et al.  A multi-stage neural network aided system for detection of microcalcifications in digitized mammograms , 2008, Neurocomputing.

[14]  B. S. Manjunath,et al.  Shape prior segmentation of multiple objects with graph cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  J. Stil,et al.  Accepted for Publication in the Astronomical Journal the Vla Galactic Plane Survey Accepted for Publication in the Astronomical Journal , 2022 .

[16]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[17]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[18]  Jordi Freixenet,et al.  Multi-Scale Image Analysis Applied to Radioastronomical Interferometric Data , 2009, IbPRIA.

[19]  B. Schiele,et al.  Interleaved Object Categorization and Segmentation , 2003, BMVC.

[20]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[21]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Luc Van Gool,et al.  Scalable multi-class object detection , 2011, CVPR 2011.

[23]  Wen Wu,et al.  SmartLabel: an object labeling tool using iterated harmonic energy minimization , 2006, MM '06.

[24]  Jue Wu,et al.  POSIT: Part-based object segmentation without intensive training , 2010, Pattern Recognit..

[25]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Fei-Fei Li,et al.  Towards Scalable Dataset Construction: An Active Learning Approach , 2008, ECCV.

[27]  M Kallergi,et al.  Evaluating the performance of detection algorithms in digital mammography. , 1999, Medical physics.

[28]  Wen Wu,et al.  Semi-Automatically Labeling Objects in Images , 2009, IEEE Transactions on Image Processing.

[29]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  William A. Barrett,et al.  Toboggan-based intelligent scissors with a four-parameter edge model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[31]  Antonio Torralba,et al.  Contextual Models for Object Detection Using Boosted Random Fields , 2004, NIPS.

[32]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[33]  Claudia Mello-Thoms,et al.  Spatial localization accuracy of radiologists in free-response studies: Inferring perceptual FROC curves from mark-rating data. , 2007, Academic radiology.

[34]  Cordelia Schmid,et al.  Accurate Object Detection with Deformable Shape Models Learnt from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Berkman Sahiner,et al.  Computer-aided detection system for clustered microcalcifications: comparison of performance on full-field digital mammograms and digitized screen-film mammograms , 2007, Physics in medicine and biology.

[36]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Xiaodong Fan Efficient multiclass object detection by a hierarchy of classifiers , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Manuel Blum,et al.  Peekaboom: a game for locating objects in images , 2006, CHI.

[39]  Xavier Cufí,et al.  Use of decision trees in colour feature selection. Application to object recognition in outdoor scenes , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[40]  Hans Bornefalk Estimation and comparison of CAD system performance in clinical settings. , 2005, Academic radiology.

[41]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[42]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[44]  Maite López-Sánchez,et al.  Adaptive case-based reasoning using retention and forgetting strategies , 2011, Knowl. Based Syst..

[45]  Feng Jun,et al.  Clustered Microcalcification Detection Based on Multiple Kernel Support Vector Machine with Grouped Features , 2010 .

[46]  Rangaraj M. Rangayyan,et al.  A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs , 2007, J. Frankl. Inst..

[47]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[49]  Laurie L Fajardo,et al.  Free-response receiver operating characteristic evaluation of lossy JPEG2000 and object-based set partitioning in hierarchical trees compression of digitized mammograms. , 2005, Radiology.

[50]  Shimon Ullman,et al.  Combining Top-Down and Bottom-Up Segmentation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[51]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  Andrew Zisserman,et al.  Learning an Alphabet of Shape and Appearance for Multi-Class Object Detection , 2008, International Journal of Computer Vision.

[53]  Nebojsa Jojic,et al.  LOCUS: learning object classes with unsupervised segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[54]  Gang Song,et al.  Object Detection Combining Recognition and Segmentation , 2007, ACCV.

[55]  Zhuowen Tu,et al.  Auto-context and its application to high-level vision tasks , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Heng-Da Cheng,et al.  Computer-aided detection and classification of microcalcifications in mammograms: a survey , 2003, Pattern Recognit..

[57]  Dimitrios I. Fotiadis,et al.  Improvement of microcalcification cluster detection in mammography utilizing image enhancement techniques , 2008, Comput. Biol. Medicine.

[58]  Joan Batlle,et al.  A new approach to outdoor scene description based on learning and top-down segmentation , 2001, Image Vis. Comput..

[59]  Ashutosh Saxena,et al.  Cascaded Classification Models: Combining Models for Holistic Scene Understanding , 2008, NIPS.

[60]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[61]  Takeo Kanade,et al.  Human Face Detection in Visual Scenes , 1995, NIPS.

[62]  Xavier Cufí,et al.  Active regions for colour texture segmentation integrating region and boundary information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[63]  Xavier Lladó,et al.  Colour Texture Segmentation by Region-Boundary Cooperation , 2004, ECCV.

[64]  Jitendra Malik,et al.  Shape Guided Object Segmentation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[65]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[66]  Cristian Sminchisescu,et al.  Constrained parametric min-cuts for automatic object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[67]  Juergen Gall,et al.  Class-specific Hough forests for object detection , 2009, CVPR.

[68]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[69]  Joan Batlle,et al.  A review on strategies for recognizing natural objects in colour images of outdoor scenes , 2000, Image Vis. Comput..

[70]  Richard H. Moore,et al.  THE DIGITAL DATABASE FOR SCREENING MAMMOGRAPHY , 2007 .

[71]  Jinchang Ren,et al.  ANN vs. SVM: Which one performs better in classification of MCCs in mammogram imaging , 2012, Knowl. Based Syst..

[72]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[73]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[74]  Deva Ramanan,et al.  Using Segmentation to Verify Object Hypotheses , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[75]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[76]  Anna Bornefalk Hermansson,et al.  On the comparison of FROC curves in mammography CAD systems. , 2005, Medical physics.

[77]  Maria Rizzi,et al.  Computer aided detection of microcalcifications in digital mammograms adopting a wavelet decomposition , 2009, Integr. Comput. Aided Eng..

[78]  E. Denton,et al.  Eigendetection of masses considering false positive reduction and breast density information. , 2008, Medical physics.

[79]  Luc Van Gool,et al.  Simultaneous Object Recognition and Segmentation from Single or Multiple Model Views , 2006, International Journal of Computer Vision.

[80]  Shai Avidan SpatialBoost: Adding Spatial Reasoning to AdaBoost , 2006, ECCV.

[81]  E. Bertin,et al.  SExtractor: Software for source extraction , 1996 .

[82]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[83]  Fei-Fei Li,et al.  OPTIMOL: Automatic Online Picture Collection via Incremental Model Learning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[84]  Kristen Grauman,et al.  Keywords to visual categories: Multiple-instance learning forweakly supervised object categorization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[85]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[86]  Mubarak Shah,et al.  3D Model based Object Class Detection in An Arbitrary View , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[87]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[88]  J. M. Paredes,et al.  Radio continuum and near-infrared study of the MGRO J2019+37 region , 2009, 0909.0406.

[89]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[90]  Alexei A. Efros,et al.  Using Multiple Segmentations to Discover Objects and their Extent in Image Collections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[91]  Peter G. Martin,et al.  The Canadian Galactic Plane Survey , 1998, Publications of the Astronomical Society of Australia.

[92]  R. Sivaramakrishna,et al.  Detection of breast cancer at a smaller size can reduce the likelihood of metastatic spread: a quantitative analysis. , 1997, Academic radiology.

[93]  Michael Brady,et al.  A biologically inspired algorithm for microcalcification cluster detection , 2006, Medical Image Anal..

[94]  Sung-Nien Yu,et al.  Detection of microcalcifications in digital mammograms using combined model-based and statistical textural features , 2010, Expert Syst. Appl..

[95]  Sergio Escalera,et al.  Boosted Landmarks of Contextual Descriptors and Forest-ECOC: A novel framework to detect and classify objects in cluttered scenes , 2007, Pattern Recognit. Lett..

[96]  Xavier Llorà,et al.  Computer aided diagnosis with case-based reasoning and genetic algorithms , 2002, Knowl. Based Syst..

[97]  Kristen Grauman,et al.  Multi-Level Active Prediction of Useful Image Annotations for Recognition , 2008, NIPS.

[98]  Andrew Blake,et al.  Multiscale Categorical Object Recognition Using Contour Fragments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[100]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[101]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[102]  Martial Hebert,et al.  Towards unsupervised whole-object segmentation: Combining automated matting with boundary detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[103]  Horace Ho-Shing Ip,et al.  Clustered Microcalcification detection based on a Multiple Kernel Support Vector Machine with Grouped Features (GF-SVM) , 2008, 2008 19th International Conference on Pattern Recognition.

[104]  S. Obenauer,et al.  Comparative study in patients with microcalcifications: full-field digital mammography vs screen-film mammography , 2002, European Radiology.

[105]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[106]  J. Freixenet,et al.  Detection of Faint Compact Radio Sources in Wide Field Interferometric Images using the Slope Stability of a Contrast Radial Function , 2009 .

[107]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[108]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[109]  R. Nevatia,et al.  Simultaneous Object Detection and Segmentation by Boosting Local Shape Feature based Classifier , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[110]  Anna Bosch Rué Image classification for a large number of object categories , 2007 .