Eigen-CSS shape matching and recognizing fish in underwater video

This thesis presents work on shape matching and object recognition. First, we describe Eigen-CSS, a faster and more accurate approach to representing and matching the curvature scale space (CSS) features of shape silhouette contours. Phase-correlated marginal-sum features and PCA eigenspace decomposition via SVD differentiate our technique from earlier work. Next, we describe a deformable template object recognition method for classifying fish species in underwater video. The efficient combination of shape contexts with larger-scale spatial structure information allows acceptable estimation of point correspondences between template and test images despite missing or inaccurate edge information. Fast distance transforms and tree-structured dynamic programming allow the efficient computation of globally optimal correspondences, and multi-class support vector machines (SVMs) are used for classification. The two methods, Eigen-CSS shape matching and deformable template matching followed by texture-based recognition, are contrasted as complementary techniques that respectively suit the unique characteristics of two substantially different computer vision problems.

[1]  Nigel J. B. McFarlane,et al.  Estimating Dimensions of Free-Swimming Fish Using 3D Point Distribution Models , 2000, Comput. Vis. Image Underst..

[2]  Dah-Jye Lee,et al.  An automated fish species classification and migration monitoring system , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[3]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[4]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[5]  Wesley E. Snyder,et al.  Application of Affine-Invariant Fourier Descriptors to Recognition of 3-D Objects , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Ulf Grenander,et al.  Hands: A Pattern Theoretic Study of Biological Shapes , 1990 .

[7]  Mark S. Drew,et al.  Shape retrieval with eigen-CSS search , 2009, Image Vis. Comput..

[8]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yali Amit,et al.  Joint Induction of Shape Features and Tree Classifiers , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jitendra Malik,et al.  Recovering 3D human body configurations using shape contexts , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Joachim Hertzberg,et al.  Contour-Based Object Detection in Range Images , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[13]  Roy S. Berns,et al.  A review of principal component analysis and its applications to color technology , 2005 .

[14]  C. Nelson.  The Development and Neural Bases of Face Recognition , 2001 .

[15]  Ghassan Hamarneh,et al.  Human Limb Delineation and Joint Position Recovery Using Localized Boundary Models , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[16]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.

[17]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[18]  Fiona F. Evans.  Detecting fish in underwater video using the EM algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Mario Fernando Montenegro Campos,et al.  Particle Filter-Based Predictive Tracking for Robust Fish Counting , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[21]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[22]  A. Frid,et al.  Biology of sea turtles under risk from tiger sharks at a foraging ground , 2005 .

[23]  Gian Luca Foresti,et al.  A Vision Based System for Object Detection in Underwater Images , 2000, Int. J. Pattern Recognit. Artif. Intell..

[24]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[25]  Jitendra Malik,et al.  Learning a discriminative classifier using shape context distances , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[26]  Hiroshi Murase,et al.  Learning Object Models from Appearance , 1993, AAAI.

[27]  Dah-Jye Lee,et al.  Contour matching for a fish recognition and migration-monitoring system , 2004, SPIE Optics East.

[28]  Hyeran Byun,et al.  Applications of Support Vector Machines for Pattern Recognition: A Survey , 2002, SVM.

[29]  Owen Robert Mitchell,et al.  Partial Shape Recognition Using Dynamic Programming , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[31]  Anil K. Jain,et al.  Object Matching Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Sadegh Abbasi,et al.  Affine-similar shape retrieval: application to multiview 3-D object recognition , 2001, IEEE Trans. Image Process..

[33]  Ze-Nian Li,et al.  Illumination color covariant locale-based visual object retrieval , 2002, Pattern Recognit..

[34]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[35]  Ari Visa,et al.  Multiscale Fourier descriptor for shape classification , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[36]  François Michaud,et al.  Intelligent system for automated fish sorting and counting , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[37]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[39]  Andrew Rova,et al.  One Fish, Two Fish, Butterfish, Trumpeter: Recognizing Fish in Underwater Video , 2007, MVA.

[40]  Jitendra Malik,et al.  Shape contexts enable efficient retrieval of similar shapes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Benjamin B. Kimia,et al.  Curves vs. skeletons in object recognition , 2005, Signal Process..

[42]  K Doi,et al.  Image feature analysis and computer-aided diagnosis in digital radiography. I. Automated detection of microcalcifications in mammography. , 1987, Medical physics.

[43]  Cordelia Schmid,et al.  Selection of scale-invariant parts for object class recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[44]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[45]  Yali Amit,et al.  Graphical Templates for Model Registration , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[47]  A. Yuille.  Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[48]  Jitendra Malik,et al.  Recognizing objects in adversarial clutter: breaking a visual CAPTCHA , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[49]  N. J. C. Strachan,et al.  Recognition of fish species by colour and shape , 1993, Image Vis. Comput..

[50]  Jitendra Malik,et al.  Geometric blur for template matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[51]  Hiroshi Murase,et al.  Illumination planning for object recognition in structured environments , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[54]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Farzin Mokhtarian,et al.  Silhouette-Based Isolated Object Recognition through Curvature Scale Space , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[58]  William Rucklidge,et al.  Efficiently Locating Objects Using the Hausdorff Distance , 1997, International Journal of Computer Vision.

[59]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[60]  Thierry Bouwmans,et al.  Alive Fishes Species Characterization from Video Sequences , 2002, SSPR/SPR.

[61]  Lawrence M. Dill,et al.  FOOD AVAILABILITY AND TIGER SHARK PREDATION RISK INFLUENCE BOTTLENOSE DOLPHIN HABITAT USE , 2002 .

[62]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[63]  Manuela M. Veloso,et al.  Automatically tracking and analyzing the behavior of live insect colonies , 2001, AGENTS '01.

[64]  Anthony P. Reeves,et al.  Three-Dimensional Shape Analysis Using Moments and Fourier Descriptors , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  Boaz J. Super,et al.  Classification of contour shapes using class segment sets , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[66]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[67]  M. Heithaus.  Habitat use and group size of pied cormorants (Phalacrocorax varius) in a seagrass ecosystem: possible effects of food abundance and predation risk , 2005 .

[68]  Miroslaw Bober,et al.  MPEG-7 visual shape descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[69]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[70]  S. Palmer.  Vision Science : Photons to Phenomenology , 1999 .

[71]  Daniel P. Huttenlocher,et al.  Efficient matching of pictorial structures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[72]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[73]  Remco C. Veltkamp,et al.  State of the Art in Shape Matching , 2001, Principles of Visual Information Retrieval.

[74]  Alex Pentland,et al.  Modal Matching for Correspondence and Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  S. Gentili,et al.  A hierarchical classification system for object recognition in underwater environments , 2002 .

[76]  Christof Koch,et al.  Detection and tracking of objects in underwater video , 2004, CVPR 2004.

[77]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Björn Stenger,et al.  Shape context and chamfer matching in cluttered scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[79]  Philip N. Klein,et al.  Recognition of Shapes by Editing Shock Graphs , 2001, ICCV.

[80]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  Pedro F. Felzenszwalb.  Representation and detection of deformable shapes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[83]  Dezhen Song,et al.  Networked Robotic Cameras for Collaborative Observation of Natural Environments , 2005, ISRR.

[84]  C.-C. Jay Kuo,et al.  Wavelet descriptor of planar curves: theory and applications , 1996, IEEE Trans. Image Process..

[85]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.