Direct computation of differential invariants of image contours from shading

We present a framework combining differential geometry and scale-space to show that local geometric invariants of image contours such as tangent, curvature and derivative of curvature can be computed directly and stably from the raw image itself. To solve the problem of noise amplification by differential operations, scale-parameterized local kernels are used to replace differential operations by integral operations, which can be carried out accurately when we adopt a continuous image model. We also show that tangent estimation along contours can be made quite accurately using only eight tangent estimators (a /spl pi//4 quantization) when contour location is known, and high precision and efficiency in computation can be achieved for each of the invariants regardless of the differential order involved.

[1]  Azriel Rosenfeld,et al.  Parallel Image Processing by Memory-Augmented Cellular Automata , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Charles R. Dyer,et al.  Cyclic motion detection using spatiotemporal surfaces and curves , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[3]  Bruce H. McCormick,et al.  A COGNITIVE ARCHITECTURE FOR COMPUTER VISION , 1982 .

[4]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition : methods that search for structures in data , 1992 .

[5]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[6]  Charles V. Stewart,et al.  Parallel simulation of a connectionist stereo algorithm on a shared-memory multiprocessor , 1990 .

[7]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[8]  Charles R. Dyer,et al.  Computing spatiotemporal relations for dynamic perceptual organization , 1993 .

[9]  Kiriakos N. Kutulakos,et al.  Occluding contour detection using affine invariants and purposive viewpoint control , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Charles R. Dyer,et al.  An algorithm for constructing the aspect graph , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[11]  W. B. Seales,et al.  Constrained viewpoint from occluding contour , 1991, [1991 Proceedings] Workshop on Directions in Automated CAD-Based Vision.

[12]  Charles R. Dyer,et al.  Interpolating view and scene motion by dynamic view morphing , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[13]  Charles R. Dyer,et al.  Interactivity and the Dimensionality of Data Displays , 1995, Perceptual Issues in Visualization.

[14]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[15]  Akira Nakamura,et al.  Nondeterministic Bottom-up Pyramid Acceptors. , 1977 .

[16]  W. Brent Seales,et al.  Viewpoint from occluding contour , 1992, CVGIP Image Underst..

[17]  C. Dyer,et al.  Dynamic shading, motion parallax and qualitative shape , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[18]  Salvatore J. Stolfo,et al.  Report on Workshop on High Performance Computing and Communications for Grand Challenge Applications: Computer Vision, Speech and Natural Language Processing, and Artificial Intelligence , 1993, IEEE Trans. Knowl. Data Eng..

[19]  Charles R. Dyer,et al.  Display of scientific data structures for algorithm visualization , 1992, Proceedings Visualization '92.

[20]  Charles R. Dyer,et al.  Shape Smoothing Using Medial Axis Properties , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Charles R. Dyer,et al.  Long-range spatiotemporal motion understanding using spatiotemporal flow curves , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Kiriakos N. Kutulakos,et al.  Object Exploration By Purposive, Dynamic Viewpoint Adjustment , 1992 .

[23]  Charles R. Dyer,et al.  Segmentation of textured images by pyramid linking , 1986 .

[24]  Charles R. Dyer,et al.  OBJECT RECOGNITION USING HOUGH PYRAMIDS. , 1985 .

[25]  W. B. Seales,et al.  Shaded rendering and shadow computation for polyhedral animation , 1990 .

[26]  H. Plantinga,et al.  The asp: A continuous viewer-centered representation for 3D object recognition , 1987 .

[27]  Dmitry B. Goldgof,et al.  Applying the scale space concept to perspective projection aspect graphs , 1992 .

[28]  Kiriakos N. Kutulakos,et al.  Toward global surface reconstruction by purposive viewpoint adjustment , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Charles R. Dyer,et al.  3-D multiview object representations for model-based object recognition , 1987, Pattern Recognit..

[30]  Charles R. Dyer,et al.  Shape Recovery from Stationary Surface Contours by Controlled Observer Motion , 1996 .

[31]  Charles R. Dyer,et al.  An analysis of node linking in overlapped pyramids , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[32]  Charles F. Neveu 2-D object recognition using multi-resolution models , 1986 .

[33]  Steven M. Seitz,et al.  Toward image-based scene representation using view morphing , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[34]  Charles V. Stewart,et al.  Scheduling Algorithms for PIPE (Pipelined Image-Processing Engine) , 1988, J. Parallel Distributed Comput..

[35]  Jan J. Koenderink,et al.  Two-dimensional curvature operators , 1988 .

[36]  M SeitzSteven,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1999 .

[37]  W. Brent Seales,et al.  Building global surface models by purposive and qualitative viewpoint adjustment , 1993, Other Conferences.

[38]  Charles R. Dyer Memory-Augmented Cellular Automata for Image Analysis. , 1978 .

[39]  Charles V. Stewart,et al.  The Trinocular General Support Algorithm: A Three-camera Stereo Algorithm For Overcoming Binocular Matching Errors , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[40]  Charles R. Dyer,et al.  The VIS-AD Data Model: Integrating Metadata and Polymorphic Display with a Scientific Programming Language , 1993, Workshop on Database Issues for Data Visualization.

[41]  Charles R. Dyer,et al.  NP-completeness of linearly-connected multiprocessor scheduling , 1987 .

[42]  Dmitry B. Goldgof,et al.  The Scale Space Aspect Graph , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[44]  W. Brent Seales,et al.  An Occlusion-Based Representation of Shape for Viewpoint Recovery , 1992, ECAI.

[45]  Kevin W. Bowyer,et al.  Aspect graphs: An introduction and survey of recent results , 1990, Int. J. Imaging Syst. Technol..

[46]  Charles R. Dyer Gauge Inspection Using Hough Transforms , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Kiriakos N. Kutulakos,et al.  Building global object models by purposive viewpoint control , 1994, Proceedings of 1994 IEEE 2nd CAD-Based Vision Workshop.

[48]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[49]  S.M. Seitz,et al.  Detecting irregularities in cyclic motion , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[50]  W. Brent Seales,et al.  Using the ASP for the Interactive Viewing of Polyhedral Scenes , 1989 .

[51]  Steven M. Seitz,et al.  Complete scene structure from four point correspondences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[52]  Charles R. Dyer,et al.  A lattice model for data display , 1994, Proceedings Visualization '94.

[53]  Charles R. Dyer,et al.  Real-time hidden-line elimination for a rotating polyhedral scene using the aspect representation , 1990 .

[54]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[55]  R DyerCharles,et al.  Model-based recognition in robot vision , 1986 .

[56]  W. Brent Seales,et al.  Modeling the rim appearance , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[57]  Vladimir J. Lumelsky,et al.  Provable strategies for vision-guided exploration in three dimensions , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[58]  S. Seitz,et al.  View Morphing: Uniquely Predicting Scene Appearance from Basis Images , 1997 .

[59]  Azriel Rosenfeld,et al.  Cellular Pyramids for Image Analysis. , 1977 .

[60]  D. Hubel,et al.  Sequence regularity and geometry of orientation columns in the monkey striate cortex , 1974, The Journal of comparative neurology.

[61]  Steven M. Seitz,et al.  Affine invariant detection of periodic motion , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[62]  Charles R. Dyer,et al.  Computing spatiotemporal surface flow , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[63]  Charles V. Stewart,et al.  Local constraint integration in a connectionist model of stereo vision , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[64]  Vladimir J. Lumelsky,et al.  Vision-guided exploration: a step toward general motion planning in three dimensions , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[65]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Yuhua Luo,et al.  2-D OBJECT RECOGNITION USING HIERARCHICAL BOUNDARY SEGMENTS. , 1985 .

[67]  Kiriakos N. Kutulakos,et al.  Global surface reconstruction by purposive control of observer motion , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[68]  C. Dyer,et al.  Node Linking Strategies in Pyramids for Image Segmentation , 1984 .

[69]  Theresa-Marie Rhyne,et al.  Visualization requirements in the atmospheric and environmental sciences (five case study reports) , 1992, Proceedings Visualization '92.

[70]  Azriel Rosenfeld,et al.  Propagation algorithms for framing rectangle construction , 1980, Pattern Recognit..

[71]  Kiriakos N. Kutulakos,et al.  Recovering shape by purposive viewpoint adjustment , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[72]  Charles R. Dyer,et al.  Recognition and recovery of the three-dimensional orientation of planar point patterns , 1986, Comput. Vis. Graph. Image Process..

[73]  Steven M. Seitz,et al.  Cyclic Motion Analysis Using the Period Trace , 1997 .

[74]  Charles R. Dyer,et al.  Affine Calibration from Dynamic Scenes , 2000 .

[75]  W. Brent Seales,et al.  Representing the dynamics of the occluding contour , 1991, Other Conferences.

[76]  Charles R. Dyer,et al.  The space efficiency of quadtrees , 1982, Comput. Graph. Image Process..

[77]  Charles R. Dyer,et al.  Real-time motion tracking of three-dimensional objects , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[78]  C R Dyer,et al.  Techniques for a structural analysis of dermatoscopic imagery. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.