Fisher Tensors for Classifying Human Epithelial Cells Fisher Tensors for Classifying Human Epithelial Cells

Analyzing and classifying Human Epithelial type 2 (HEp-2) cells using Indirect Immunofluorescence protocol has been the golden standard for detecting connective tissue diseases such as Rheumatoid Arthritis. However, this suffers from numerous shortcomings such as being subjective as well as time and labour intensive. Recently, several studies explore the advantages of artificial systems to automate the process, not only to reduce the test turn-around time but also to deliver more consistent results. In this paper, we extend the conventional bag of word models from Euclidean space to non-Euclidean Riemannian manifolds and utilize them to classify the HEp-2 cells. The main motivation comes from the observation that HEp-2 cells can be efficiently described by symmetric positive definite matrices which lie on a Riemannian manifold. With this motivation, we first discuss an intrinsic bag of Riemannian words model. We then propose Fisher tensors which can in turn encode additional information about the distribution of the signatures in a bag of word model. Experiments on two challenging HEp-2 images datasets, namely ICPRContest and SNPHEp-2 show that the proposed methods obtain notable improvements in discrimination accuracy, in comparison to baseline and several state-of-the-art methods. The proposed framework, while hand-crafted towards cell classification, is a generic framework for object recognition. This is supported by assessing the performance of our proposal on a challenging texture classification task.

[1]  R. Bhatia Positive Definite Matrices , 2007 .

[2]  Brian C. Lovell,et al.  Kernel analysis on Grassmann manifolds for action recognition , 2013, Pattern Recognit. Lett..

[3]  Anoop Cherian,et al.  Jensen-Bregman LogDet Divergence with Application to Efficient Similarity Search for Covariance Matrices , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Mario Vento,et al.  Benchmarking HEp-2 Cells Classification Methods , 2013, IEEE Transactions on Medical Imaging.

[5]  Janusz Konrad,et al.  Action Recognition From Video Using Feature Covariance Matrices , 2013, IEEE Transactions on Image Processing.

[6]  Baba C. Vemuri,et al.  A Novel Dynamic System in the Space of SPD Matrices with Applications to Appearance Tracking , 2013, SIAM J. Imaging Sci..

[7]  Yongkang Wong,et al.  Classification of Human Epithelial type 2 cell indirect immunofluoresence images via codebook based descriptors , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[8]  Brian C. Lovell,et al.  Spatio-temporal covariance descriptors for action and gesture recognition , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[9]  Xiaoqin Zhang,et al.  Single and Multiple Object Tracking Using Log-Euclidean Riemannian Subspace and Block-Division Appearance Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dimitris Kastaniotis,et al.  HEp-2 Cells classification via fusion of morphological and textural features , 2012, 2012 IEEE 12th International Conference on Bioinformatics & Bioengineering (BIBE).

[11]  Jesús Angulo,et al.  Efficient statistical/morphological cell texture characterization and classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[12]  Fredrik Kahl,et al.  HEp-2 staining pattern classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[13]  Enrico Macii,et al.  Applying textural features to the classification of HEp-2 cell patterns in IIF images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Brian C. Lovell,et al.  Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach , 2012, ECCV.

[15]  David A. Clausi,et al.  Sorted random projections for robust rotation-invariant texture classification , 2012, Pattern Recognit..

[16]  Yui Man Lui,et al.  Advances in matrix manifolds for computer vision , 2012, Image Vis. Comput..

[17]  Brian C. Lovell,et al.  Kernel analysis over Riemannian manifolds for visual recognition of actions, pedestrians and textures , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[18]  Frédéric Jurie,et al.  Modeling spatial layout with fisher vectors for image categorization , 2011, 2011 International Conference on Computer Vision.

[19]  Rui Caseiro,et al.  A nonparametric Riemannian framework on tensor field with application to foreground segmentation , 2011, 2011 International Conference on Computer Vision.

[20]  Anoop Cherian,et al.  Generalized Dictionary Learning for Symmetric Positive Definite Matrices with Application to Nearest Neighbor Retrieval , 2011, ECML/PKDD.

[21]  Paolo Soda,et al.  Color to grayscale staining pattern representation in IIF , 2011, 2011 24th International Symposium on Computer-Based Medical Systems (CBMS).

[22]  Trevor Darrell,et al.  What you saw is not what you get: Domain adaptation using asymmetric kernel transforms , 2011, CVPR 2011.

[23]  A. Wiik,et al.  Antinuclear antibodies: a contemporary nomenclature using HEp-2 cells. , 2010, Journal of autoimmunity.

[24]  Mario Vento,et al.  Early experiences in mitotic cells recognition on HEp-2 slides , 2010, 2010 IEEE 23rd International Symposium on Computer-Based Medical Systems (CBMS).

[25]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[26]  Lewis D. Griffin,et al.  Using Basic Image Features for Texture Classification , 2010, International Journal of Computer Vision.

[27]  P. Schur,et al.  ANA screening: an old test with new recommendations , 2010, Annals of the rheumatic diseases.

[28]  Yu-Len Huang,et al.  HEp-2 cell classification in indirect immunofluorescence images , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[29]  Rico Hiemann,et al.  Challenges of automated screening and differentiation of non-organ specific autoantibodies on HEp-2 cells. , 2009, Autoimmunity reviews.

[30]  Peter Meer,et al.  Nonlinear Mean Shift over Riemannian Manifolds , 2009, International Journal of Computer Vision.

[31]  Pierre Elbischger,et al.  Algorithmic framework for HEp-2 fluorescence pattern classification to aid auto-immune diseases diagnosis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[32]  Giulio Iannello,et al.  Aggregation of Classifiers for Staining Pattern Recognition in Antinuclear Autoantibodies Analysis , 2009, IEEE Transactions on Information Technology in Biomedicine.

[33]  Barbara Caputo,et al.  Discriminative cue integration for medical image annotation , 2008, Pattern Recognit. Lett..

[34]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Xuelong Li,et al.  Gabor-Based Region Covariance Matrices for Face Recognition , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[38]  Martin Weigert,et al.  Automatic Analysis of Immunofluorescence Patterns of HEp‐2 Cells , 2007, Annals of the New York Academy of Sciences.

[39]  Florent Perronnin,et al.  Fisher Kernels on Visual Vocabularies for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Nicholas Ayache,et al.  Geometric Means in a Novel Vector Space Structure on Symmetric Positive-Definite Matrices , 2007, SIAM J. Matrix Anal. Appl..

[41]  Lewis D. Griffin,et al.  Feature category systems for 2nd order local image structure induced by natural image statistics and otherwise , 2007, Electronic Imaging.

[42]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[43]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[44]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[45]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[46]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[47]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Mario Fritz,et al.  On the Significance of Real-World Conditions for Material Classification , 2004, ECCV.

[49]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Petra Perner,et al.  Mining knowledge for HEp-2 cell image classification , 2002, Artif. Intell. Medicine.

[51]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[53]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[54]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  A. C. Thompson ON CERTAIN CONTRACTION MAPPINGS IN A PARTIALLY ORDERED VECTOR SPACE , 1963 .

[56]  Yan Yang,et al.  Classification of human epithelial type 2 cell images using independent component analysis , 2013, 2013 IEEE International Conference on Image Processing.

[57]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[58]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[59]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .