Geometry and Photometry in 3D Visual Recognition

The report addresses the problem of visual recognition under two sources of variability: geometric and photometric. The geometric deals with the relation between 3D objects and their views under orthographic and perspective projection. The photometric deals with the relation between 3D matte objects and their images under changing illumination conditions. Taken together, an alignment-based method is presented for recognizing objects viewed from arbitrary viewing positions and illuminated by arbitrary settings of light sources.

[1]  L CHARNWOOD,et al.  Mathematical analysis of binocular vision. , 1948, The Optician.

[2]  Paul M. Laporte,et al.  Mathematical Analysis of Binocular Vision , 1950 .

[3]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[4]  C. M. Mooney.  Recognition of ambiguous and unambiguous visual configurations with short and longer exposures. , 1960, British journal of psychology.

[5]  E. Warrington,et al.  A disorder of simultaneous form perception. , 1962, Brain : a journal of neurology.

[6]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[7]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[8]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[9]  Annita Tuller.  A modern introduction to geometries , 1967 .

[10]  David Gans,et al.  Transformations and geometries , 1969 .

[11]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[12]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[13]  J. Pokorny.  Foundations of Cyclopean Perception , 1972 .

[14]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[15]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  Berthold K. P. Horn.  Image Intensity Understanding , 1975 .

[17]  W. Faig.  CALIBRATION OF CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS: MATHEMATICAL FORMULATION , 1975 .

[18]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[19]  T. Trowbridge,et al.  Average irregularity representation of a rough surface for ray reflection , 1975 .

[20]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  B. Logan.  Information in the zero crossings of bandpass signals , 1977, The Bell System Technical Journal.

[22]  S E Palmer,et al.  Structural aspects of visual similarity , 1978, Memory & cognition.

[23]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[24]  A. Gilchrist.  The perception of surface blacks and whites. , 1979, Scientific American.

[25]  Larry S. Davis,et al.  Shape Matching Using Relaxation Techniques , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[27]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[28]  Jake K. Aggarwal,et al.  Computer Tracking of Objects Moving in Space , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[31]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[32]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[33]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[34]  William B. Thompson,et al.  Lower-Level Estimation and Interpretation of Visual Motion , 1981, Computer.

[35]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[36]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[37]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[38]  I. Rock,et al.  The effect on form perception of change of orientation in the third dimension. , 1981, Journal of experimental psychology. Human perception and performance.

[39]  Robert J Douglass,et al.  Interpreting three-dimensional scenes: A model building approach , 1981 .

[40]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[41]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[42]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[43]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[44]  W E Grimson,et al.  A computational theory of visual surface interpolation. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[46]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[47]  J. Canny.  Finding Edges and Lines in Images , 1983 .

[48]  S. Pinker,et al.  Visual cognition : An introduction * , 1989 .

[49]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[50]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[52]  W. Grimson,et al.  Model-Based Recognition and Localization from Sparse Range or Tactile Data , 1984 .

[53]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[54]  Jonathan H Connell,et al.  Learning Shape Descriptions: Generating and Generalizing Models of Visual Objects , 1985 .

[55]  Irving Biederman,et al.  Human image understanding: Recent research and a theory , 1985, Comput. Vis. Graph. Image Process..

[56]  H. Baird.  Model-Based Image Matching Using Location , 1985 .

[57]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[58]  P. Jolicoeur.  The time to name disoriented natural objects , 1985, Memory & cognition.

[59]  Allen M. Waxman,et al.  Contour Evolution, Neighborhood Deformation, and Global Image Flow: Planar Surfaces in Motion , 1985 .

[60]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[61]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.

[62]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[63]  V. Ramachandran,et al.  Spatial phase and frequency in motion capture of random-dot patterns. , 1985, Spatial vision.

[64]  B. D. Lucas.  Generalized image matching by the method of differences , 1985 .

[65]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[66]  G. J. Mitchison,et al.  Interpolation in stereoscopic matching , 1985, Nature.

[67]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[68]  K. PRAZDNY.  ‘Capture’ of stereopsis by illusory contours , 1986, Nature.

[69]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[70]  W. Eric L. Grimson,et al.  The combinatorics of local constraints in model-based recognition and localization from sparse data , 1984, JACM.

[71]  V S Ramachandran,et al.  Capture of stereopsis and apparent motion by illusory contours , 1986, Perception & psychophysics.

[72]  Wolfgang Spohn,et al.  The Representation of , 1986 .

[73]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[74]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[75]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[76]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[77]  James V. Mahoney,et al.  Image Chunking: Defining Spatial Building Blocks for Scene Analysis , 1987 .

[78]  A. Remole.  PERCEPTION WITH AN EYE FOR MOTION , 1987 .

[79]  D. Metzler,et al.  Mental rotation: effects of dimensionality of objects and type of task. , 1988, Journal of experimental psychology. Human perception and performance.

[80]  P. V. Hove,et al.  Model-Based Silhouette Recognition , 1988 .

[81]  Shimon Ullman,et al.  Aligning A Model To An Image Using Minimal Information , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[82]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[83]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[84]  Chia-Hoang Lee.  Structure And Motion From Two Perspective Views Via Planar Patch , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[85]  Thomas S. Huang,et al.  Motion and Structure from Orthographic Projections , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[87]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[88]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[89]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[90]  Thomas S. Huang,et al.  Image Representation by Sign Information , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[91]  K Nakayama,et al.  Stereoscopic Depth: Its Relation to Image Segmentation, Grouping, and the Recognition of Occluded Objects , 1989, Perception.

[92]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[93]  M. A. Snyder,et al.  Robustness of correspondence-based structure from motion , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[94]  Kirk Martinez,et al.  Computer Generated Cartoons , 1990 .

[95]  W. Eric L. Grimson,et al.  On the Sensitivity of the Hough Transform for Object Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[96]  Shimon Edelman,et al.  Viewpoint-specific Representations in Three-dimensional Object Recognition , 1990 .

[97]  Jitendra Malik,et al.  Detecting and localizing edges composed of steps, peaks and roofs , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[98]  S. Ullman,et al.  Grouping Contours by Iterated Pairing Network , 1990, NIPS 1990.

[99]  Berthold K. P. Horn.  Relative orientation revisited , 1991 .

[100]  Amnon Shashua,et al.  Illumination and View Position in 3D Visual Recognition , 1991, NIPS.

[101]  R. Woodham,et al.  Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength , 1991 .

[102]  C. Tomasi,et al.  Factoring image sequences into shape and motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[103]  A. Shashua.  Correspondence and Affine Shape from Two Orthographic Views: Motion and Recognition , 1991 .

[104]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[105]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[106]  Brian Subirana.  Perceptual Organization, Giure Ground, Attention And Saliency , 1991 .

[107]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[108]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[109]  Todd A. Cass,et al.  Polynomial-Time Object Recognition in the Presence of Clutter, Occlusion, and Uncertainty , 1992, ECCV.

[110]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[111]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[112]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[113]  Ellen C. Hildreth,et al.  Recovering heading for visually-guided navigation , 1992, Vision Research.

[114]  Shimon Ullman,et al.  Contour matching using local affine transformations , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[115]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[116]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[117]  William Wells,et al.  Statistical object recognition , 1993 .

[118]  Amnon Shashua,et al.  Projective Structure from Uncalibrated Images: Structure From Motion and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..