Classifier combination for sketch-based 3D part retrieval

In this paper, we present a search method with multi-class probability estimates for sketch-based 3D engineering part retrieval. The purpose of using probabilistic output from classification is to support high-quality part retrieval by motivating user relevance feedback from a ranked list of top categorical choices. Given a free-hand user sketch, we use an ensemble of classifiers to estimate the likelihood of the sketch belonging to each predefined category by exploring the strengths of various individual classifiers. Complementary shape descriptors are used to generate classifiers with probabilistic output using support vector machines (SVM). A weighted linear combination rule, called adapted minimum classification error (AMCE), is developed to concurrently minimize the classification errors and the log likelihood errors. Experiments are conducted using our Engineering Shape Benchmark database to evaluate the proposed combination rule. User studies show that users can easily identify the desired classes and then the parts under the proposed method and algorithms. Compared with the best individual classifier, the classification accuracy using AMCE increased by 7% for 3D models, and the average best rank improved by 11.6% for sketches.

[1]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[2]  Karthik Ramani,et al.  On visual similarity based 2D drawing retrieval , 2006, Comput. Aided Des..

[3]  Rong Yan,et al.  On predicting rare classes with SVM ensembles in scene classification , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[4]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[5]  Antanas Verikas,et al.  Soft combination of neural classifiers: A comparative study , 1999, Pattern Recognit. Lett..

[6]  Fabio Roli,et al.  A theoretical and experimental analysis of linear combiners for multiple classifier systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  François Fouss,et al.  A maximum entropy approach to multiple classifiers combination , 2004 .

[8]  Karthik Ramani,et al.  A Probability-Based Unified 3D Shape Search , 2006, SAMT.

[9]  Rong Xiao,et al.  Smart Sketchpad-an on-line graphics recognition system , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[10]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Naonori Ueda,et al.  Optimal Linear Combination of Neural Networks for Improving Classification Performance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Levent Burak Kara,et al.  An image-based, trainable symbol recognizer for hand-drawn sketches , 2005, Comput. Graph..

[13]  UedaNaonori Optimal Linear Combination of Neural Networks for Improving Classification Performance , 2000 .

[14]  Joaquim A. Jorge,et al.  Using fuzzy logic to recognize geometric shapes interactively , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[15]  Johannes R. Sveinsson,et al.  Parallel consensual neural networks , 1997, IEEE Trans. Neural Networks.

[16]  A. Richard Newton,et al.  Sketched symbol recognition using Zernike moments , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[18]  Fabio Roli,et al.  Ensembles of Neural Networks for Soft Classification of Remote Sensing Images , 1997 .

[19]  Andrew W. Senior,et al.  A Combination Fingerprint Classifier , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Tsuhan Chen,et al.  An active learning framework for content-based information retrieval , 2002, IEEE Trans. Multim..

[21]  Karthik Ramani,et al.  Sketch-based 3D engineering part class browsing and retrieval , 2006, SBM'06.

[22]  Josef Kittler,et al.  Combining multiple classifiers by averaging or by multiplying? , 2000, Pattern Recognit..

[23]  Julian D Booker,et al.  Process Selection: From Design to Manufacture , 1997 .

[24]  J. O'Brien Correlated probability fusion for multiple class discrimination , 1999, 1999 Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No.99EX251).

[25]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[26]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Guojun Lu,et al.  Content-based shape retrieval using different shape descriptors: a comparative study , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[28]  Christopher DeCoro,et al.  Hierarchical Shape Classification Using Bayesian Aggregation , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[29]  William C. Regli,et al.  Manufacturing Processes Recognition of Machined Mechanical Parts using SVMs , 2005, AAAI.

[30]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[31]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[32]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  A. Newton,et al.  Sketched symbol recognition using Zernike moments , 2004, ICPR 2004.

[34]  Sherif Hashem,et al.  Optimal Linear Combinations of Neural Networks , 1997, Neural Networks.

[35]  Levent Burak Kara,et al.  An Image-Based Trainable Symbol Recognizer for Sketch-Based Interfaces , 2004, AAAI Technical Report.

[36]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[37]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..

[38]  Karthik Ramani,et al.  A 3D Model Retrieval Method Using 2D Freehand Sketches , 2005, International Conference on Computational Science.

[39]  William C. Regli,et al.  Content-Based Classification of CAD Models with Supervised Learning , 2005 .