Binary plankton image classification using random subspace

In this paper, we implement a random subspace based algorithm to classify the plankton images detected in real time by the shadowed image particle profiling and evaluation recorder. The difficulty of such classification is compounded because the data sets are not only much noisier but the plankton are deformable, projection-variant, and often in partial occlusion. In addition, the images in our experiments are binary thus are lack of texture information. Using random sampling, we construct a set of stable classifiers to take full advantage of nearly all the discriminative information in the feature space of plankton images. The combination of multiple stable classifiers is better than a single classifier. We achieve over 93% classification accuracy on a collection of more than 3000 images, making it comparable with what a trained biologist can achieve by using conventional manual techniques.

[1]  Harry Shum,et al.  Automatic 3D face modeling from video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Harry Shum,et al.  Picture Collage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Matti Pietikäinen,et al.  An Experimental Comparison of Autoregressive and Fourier-Based Descriptors in 2D Shape Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yasuyuki Matsushita,et al.  Space-Time Video Montage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Dacheng Tao,et al.  Random sampling based SVM for relevance feedback image retrieval , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Xiaogang Wang,et al.  Subspace analysis using random mixture models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Xinbo Gao,et al.  Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing , 2002, IEEE Trans. Circuits Syst. Video Technol..

[9]  Dong Xu,et al.  Face Verification With Balanced Thresholds , 2007, IEEE Transactions on Image Processing.

[10]  Xiaoou Tang,et al.  Optical and Sonar Image Classification: Wavelet Packet Transform vs Fourier Transform , 2000, Comput. Vis. Image Underst..

[11]  Shuicheng Yan,et al.  Formulating Face Verification With Semidefinite Programming , 2007, IEEE Transactions on Image Processing.

[12]  Andrea Trucco,et al.  High-resolution in situ holographic recording and analysis of marine organisms and particles (HOLOMAR) , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[13]  Zhenguo Li,et al.  Shape from regularities for interactive 3D reconstruction of piecewise planar objects from single images , 2006, MM '06.

[14]  Xiaogang Wang,et al.  Unified subspace analysis for face recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Xinbo Gao,et al.  A spatial-temporal approach for video caption detection and recognition , 2002, IEEE Trans. Neural Networks.

[16]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[17]  Feng Lin,et al.  Video-based handwritten Chinese character recognition , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Harry Shum,et al.  Interactive Offline Tracking for Color Objects , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[19]  Xuelong Li,et al.  Insignificant shadow detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Yu Qiao,et al.  On-line handwritten signature verification using hidden Markov model features , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[21]  Zhifeng Li,et al.  Bayesian face recognition using support vector machine and face clustering , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[23]  Dahua Lin,et al.  Conditional Infomax Learning: An Integrated Framework for Feature Extraction and Fusion , 2006, ECCV.

[24]  Xiaogang Wang,et al.  Random Sampling for Subspace Face Recognition , 2006, International Journal of Computer Vision.

[25]  Mo Chen,et al.  Progressive Cut: An Image Cutout Algorithm that Models User Intentions , 2007, IEEE MultiMedia.

[26]  Dacheng Tao,et al.  Orthogonal complement component analysis for positive samples in SVM based relevance feedback image retrieval , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[27]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xuelong Li,et al.  Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm , 2006, IEEE Transactions on Multimedia.

[29]  Xiaoou Tang,et al.  Evolutionary Search for Faces from Line Drawings , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Xiaoou Tang,et al.  A Hybrid Graph Model for Unsupervised Object Segmentation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  Shuicheng Yan,et al.  A Parameter-Free Framework for General Supervised Subspace Learning , 2007, IEEE Transactions on Information Forensics and Security.

[32]  Chi-Keung Tang,et al.  Limits of Learning-Based Superresolution Algorithms , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[33]  Feng Lin,et al.  Dynamic stroke information analysis for video-based handwritten Chinese character recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Dahua Lin,et al.  Coupled space learning of image style transformation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[35]  Dong Xu,et al.  Trace Ratio vs. Ratio Trace for Dimensionality Reduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Harry Shum,et al.  Real-Time Bayesian 3-D Pose Tracking , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Xiaogang Wang,et al.  Random sampling LDA for face recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[38]  He Huang,et al.  Automatic Plankton Image Recognition , 1998, Artificial Intelligence Review.

[39]  Yi Deng,et al.  Stereo Correspondence with Occlusion Handling in a Symmetric Patch-Based Graph-Cuts Model , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Hanqing Lu,et al.  Face recognition using kernel scatter-difference-based discriminant analysis , 2006, IEEE Trans. Neural Networks.

[41]  Stephen Lin,et al.  Rank-one Projections with Adaptive Margins for Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[42]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Yi Deng,et al.  A symmetric patch-based correspondence model for occlusion handling , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[44]  Dahua Lin,et al.  Nonparametric subspace analysis for face recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  G. Matheron Random Sets and Integral Geometry , 1976 .

[46]  Xiaogang Wang,et al.  Face sketch synthesis and recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[47]  Zhifeng Li,et al.  Using Support Vector Machines to Enhance the Performance of Bayesian Face Recognition , 2007, IEEE Transactions on Information Forensics and Security.

[48]  Zhenguo Li,et al.  A Closed-form Solution to 3D Reconstruction of Piecewise Planar Objects from Single Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Scott Samson,et al.  A system for high-resolution zooplankton imaging , 2001 .

[50]  Yuandong Tian,et al.  EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking , 2007, CHI.

[51]  Feng Lin,et al.  Binary Plankton Image Classification , 2006, IEEE Journal of Oceanic Engineering.

[52]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[53]  Yu Chen,et al.  A Divide-and-Conquer Approach to 3D Object Reconstruction from Line Drawings , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[54]  Rong Xiao,et al.  Dynamic Cascades for Face Detection , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[55]  Deli Zhao,et al.  Laplacian PCA and Its Applications , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[56]  Shuicheng Yan,et al.  Trace Quotient Problems Revisited , 2006, ECCV.

[57]  C. Davis The Video Plankton Recorder (VPR) : Design and initial results , 1992 .

[58]  Liangliang Cao,et al.  3D object reconstruction from a single 2D line drawing without hidden lines , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[59]  Deli Zhao,et al.  Linear Laplacian Discrimination for Feature Extraction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Harry Shum,et al.  Background Cut , 2006, ECCV.

[61]  Jianzhuang Liu,et al.  Identifying Faces in a 2D Line Drawing Representing a Manifold Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Shu Yang,et al.  Fisher+Kernel criterion for discriminant analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[63]  Dahua Lin,et al.  Quality-Driven Face Occlusion Detection and Recovery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[65]  Yasuyuki Matsushita,et al.  An Intensity Similarity Measure in Low-Light Conditions , 2006, ECCV.

[66]  Zhifeng Li,et al.  Frame synchronization and multi-level subspace analysis for video based face recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[67]  Xiaoou Tang,et al.  Imlooking: image-based face retrieval in online dating profile search , 2006, CHI EA '06.

[68]  Dong Xu,et al.  Discriminant analysis with tensor representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[69]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Songde Ma,et al.  Guest Editorial: Introduction to the Special Issue on Image- and Video-Based Biometrics - Part II , 2004, IEEE Trans. Circuits Syst. Video Technol..

[71]  Harry Shum,et al.  Bidirectional tracking using trajectory segment analysis , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[72]  Xiaoou Tang,et al.  Texture information in run-length matrices , 1998, IEEE Trans. Image Process..

[73]  Dahua Lin,et al.  Recognize High Resolution Faces: From Macrocosm to Microcosm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[74]  Xiaogang Wang,et al.  Face sketch recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[75]  Shuicheng Yan,et al.  Pursuing Informative Projection on Grassmann Manifold , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[76]  Liangliang Cao,et al.  Iterative MAP and ML Estimations for Image Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[77]  Zhifeng Li,et al.  Spatio-temporal Embedding for Statistical Face Recognition from Video , 2006, ECCV.

[78]  Xiaogang Wang,et al.  Dual-space linear discriminant analysis for face recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[79]  Harry Shum,et al.  Accurate Face Alignment using Shape Constrained Markov Network , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[80]  Yasuyuki Matsushita,et al.  Video Completion by Motion Field Transfer , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[81]  Hanqing Lu,et al.  A nonlinear approach for face sketch synthesis and recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[82]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[83]  Liangliang Cao,et al.  3D object retrieval using 2D line drawing and graph based relevance reedback , 2006, MM '06.

[84]  Zhenguo Li,et al.  Noise Robust Spectral Clustering , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[85]  Xiaoou Tang,et al.  Image inpainting by global structure and texture propagation , 2007, ACM Multimedia.

[86]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  Xiaoou Tang,et al.  Efficient search of faces from complex line drawings , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[88]  Hanumant Singh,et al.  Guest editorial special issue on underwater image and video processing , 2003 .

[89]  Xiaoou Tang,et al.  Multiple competitive learning network fusion for object classification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[90]  Dahua Lin,et al.  Hallucinating faces: TensorPatch super-resolution and coupled residue compensation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[91]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[92]  Harry Shum,et al.  Patch based blind image super resolution , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[93]  Shuicheng Yan,et al.  Learning Semantic Patterns with Discriminant Localized Binary Projections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[94]  Junfeng He,et al.  Detecting Doctored JPEG Images Via DCT Coefficient Analysis , 2006, ECCV.

[95]  Yuandong Tian,et al.  A Face Annotation Framework with Partial Clustering and Interactive Labeling , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[96]  Deli Zhao,et al.  Contextual Distance for Data Perception , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[97]  Shu Yang,et al.  Bilinear Analysis for Kernel Selection and Nonlinear Feature Extraction , 2007, IEEE Transactions on Neural Networks.

[98]  Dahua Lin,et al.  Inter-modality Face Recognition , 2006, ECCV.

[99]  Yuandong Tian,et al.  Joint Boosting Feature Selection for Robust Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[100]  Dahua Lin,et al.  Discriminant Mutual Subspace Learning for Indoor and Outdoor Face Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[101]  Harry Shum,et al.  Flash Cut: Foreground Extraction with Flash and No-flash Image Pairs , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[102]  Rongrong Wang,et al.  Detecting doctored images using camera response normality and consistency , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[103]  Lin Liang,et al.  An Integrated Model for Accurate Shape Alignment , 2006, ECCV.

[104]  Liangliang Cao,et al.  Degen Generalized Cylinders and Their Properties , 2006, ECCV.

[105]  Harry Shum,et al.  A Bayesian mixture model for multi-view face alignment , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).