Analysis and Interpretation of Range Images

Computer vision researchers have been frustrated in their attempts to automatically derive depth information from conventional two-dimensional intensity images. Research on "shape from texture", "shape from shading", and "shape from focus" is still in a laboratory stage and had not seen much use in commercial machine vision systems. A range image or a depth map contains explicit information about the distance from the sensor to the object surfaces within the field of view in the scene. Information about "surface geometry" which is important for, say, three-dimensional object recognition is more easily extracted from "2 1/2 D" range images than from "2D" intensity images. As a result, both active sensors such as laser range finders and passive techniques such as multi-camera stereo vision are being increasingly utilized by vision researchers to solve a variety of problems. This book contains chapters written by distinguished computer vision researchers covering the following areas: Overview of 3D Vision Range Sensing Geometric Processing Object Recognition Navigation Inspection Multisensor Fusion A workshop report, written by the editors, also appears in the book. It summarizes the state of the art and proposes future research directions in range image sensing, processing, interpretation, and applications. The book also contains an extensive, up-to-date bibliography on the above topics. This book provides a unique perspective on the problem of three-dimensional sensing and processing; it is the only comprehensive collection of papers devoted to range images. Both academic researchers interested in research issues in 3D vision and industrial engineers in search of solutions to particular problems will find this a useful reference book.

[1]  Takeo Kanade,et al.  End of year report for parallel vision algorithm design and implementation : January 15, 1987-January 14, 1988 , 1987 .

[2]  Jake K. Aggarwal,et al.  Thermal and visual information fusion for outdoor scene perception , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[3]  Azriel Rosenfeld,et al.  Noise reduction in three-dimensional digital images , 1984, Pattern Recognit..

[4]  Hans P. Moravec,et al.  The Stanford Cart and the CMU Rover , 1983, Proceedings of the IEEE.

[5]  W. C. Graustein,et al.  Surface analysis methods , 1986 .

[6]  C. Hsiung A first course in differential geometry , 1981 .

[7]  Azriel Rosenfeld,et al.  Digital Picture Processing, Volume 1 , 1982 .

[8]  P. Besl Geometric modeling and computer vision , 1988, Proc. IEEE.

[9]  Theodosios Pavlidis,et al.  Structural pattern recognition , 1977 .

[10]  F. Hampel Contributions to the theory of robust estimation , 1968 .

[11]  Gregory D. Hager,et al.  Active reduction of uncertainty in multisensor systems , 1988 .

[12]  Yehezkel Lamdan,et al.  On recognition of 3-D objects from 2-D images , 2011, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[13]  B. O'neill Elementary Differential Geometry , 1966 .

[14]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jake K. Aggarwal,et al.  Integrated Analysis of Thermal and Visual Images for Scene Interpretation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[17]  Katsushi Ikeuchi,et al.  Determining Grasp Configurations using Photometric Stereo and the PRISM Binocular Stereo System , 1986 .

[18]  V. Berzins Accuracy of laplacian edge detectors , 1984 .

[19]  Jake K. Aggarwal,et al.  Localization of objects from range data , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Aviv Bergman,et al.  Noise-Tolerant Range Analysis for Autonomous Navigation , 1986, AAAI.

[21]  Kim L. Boyer,et al.  Depth Perception for Robots: Structural Stereo from Extended Laplacian-of-Gaussian Features , 1989 .

[22]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[23]  M. Brady Criteria for Representations of Shape , 1983 .

[24]  P. Rousseeuw Least Median of Squares Regression , 1984 .

[25]  Irving Biederman,et al.  Human image understanding: Recent research and a theory , 1985, Comput. Vis. Graph. Image Process..

[26]  Juan Carlos Esteva,et al.  3D object pose form clustering with multiple views , 1985, Pattern Recognit. Lett..

[27]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[28]  Jake K. Aggarwal,et al.  Experiments in combining intensity and range-edge maps , 1982, Comput. Graph. Image Process..

[29]  Jake K. Aggarwal,et al.  Detection of Edges Using Range Information , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Gene H. Golub,et al.  Matrix computations , 1983 .

[31]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[32]  Narendra Ahuja,et al.  EXTRACTING SURFACES FROM STEREO IMAGES: AN INTEGRATED APPROACH. , 1987 .

[33]  Richard H. Bartels,et al.  Least-squares fitting using orthogonal multinomials , 1985, TOMS.

[34]  Aristides A. G. Requicha,et al.  Mathematical Foundations of Constructive Solid Geometry: General Topology of Closed Regular Sets , 1978 .

[35]  Jake K. Aggarwal,et al.  Volume/surface octrees for the representation of three-dimensional objects , 1986, Comput. Vis. Graph. Image Process..

[36]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[37]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[38]  Jake K. Aggarwal,et al.  Image segmentation by conventional and information-integrating techniques: a synopsis , 1985, Image Vis. Comput..

[39]  A. Pentland Recognition by Parts , 1987 .

[40]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[41]  Paul J. Besl,et al.  Surfaces in Range Image Understanding , 1988, Springer Series in Perception Engineering.

[42]  Bir Bhanu,et al.  CAD-Based 3D Object Representation for Robot Vision , 1987, Computer.

[43]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[44]  David Lee,et al.  Optimal algorithms for image understanding: Current status and future plans , 1985, J. Complex..

[45]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[46]  Manfred H. Hueckel A Local Visual Operator Which Recognizes Edges and Lines , 1973, JACM.

[47]  Jake K. Aggarwal,et al.  Curvature-based representation of objects from range data , 1986, Image Vis. Comput..

[48]  G. Box NON-NORMALITY AND TESTS ON VARIANCES , 1953 .

[49]  Anil K. Jain,et al.  Segmentation and Classification of Range Images , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  R. Anderson,et al.  Tables of orthogonal polynomial values extended to N=104 , 1942 .

[51]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[52]  M. Berry,et al.  Umbilic points on Gaussian random surfaces , 1977 .

[53]  Ramakant Nevatia,et al.  Depth measurement by motion stereo , 1976 .

[54]  B. Julesz Binocular depth perception of computer-generated patterns , 1960 .

[55]  I. Faux,et al.  Computational Geometry for Design and Manufacture , 1979 .

[56]  W. Whittaker,et al.  June 1987 annual report : development of an integrated mobile robot system at Carnegie Mellon , 1987 .

[57]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[58]  John Law,et al.  Robust Statistics—The Approach Based on Influence Functions , 1986 .

[59]  David Lee,et al.  Some computational aspects of low-level computer vision , 1988, Proc. IEEE.

[60]  Herbert Freeman,et al.  Computer Processing of Line-Drawing Images , 1974, CSUR.

[61]  Charles R. Dyer,et al.  3-D multiview object representations for model-based object recognition , 1987, Pattern Recognit..

[62]  Y. Aloimonos,et al.  Visual shape computation , 1988, Proc. IEEE.

[63]  R. DeMori,et al.  Handbook of pattern recognition and image processing , 1986 .

[64]  Jake K. Aggarwal,et al.  Using multisensory images to derive the structure of three-dimensional objects - A review , 1985, Comput. Vis. Graph. Image Process..

[65]  Leon D. Harmon,et al.  Automated Tactile Sensing , 1982 .

[66]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[67]  Lothar Rossol,et al.  CONSIGHT-I: A Vision-Controlled Robot System for Transferring Parts from Belt Conveyors , 1979 .

[68]  J. K. Aggarwal,et al.  SHAPE RECOGNITION FROM SINGLE SILHOUETTES. , 1987 .

[69]  M. Asada Building A 3-D World Model For A Mobile Robot From Sensory Data , 1990 .

[70]  Paul Kinahan,et al.  The Theory of Three-Dimensional Image Reconstruction for PET , 1987, IEEE Transactions on Medical Imaging.

[71]  Theodosios Pavlidis The Use of a Syntactic Shape Analyzer for Contour Matching , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[73]  Baba C. Vemuri,et al.  Representation and recognition of objects from dense range maps , 1987 .

[74]  Y. H. Yang,et al.  A Simple Contour Matching Algorithm , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Kenneth S. Roberts,et al.  A new representation for a line , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[76]  T. Kanade,et al.  Sensor Fusion of Range and Reflectance Data for Outdoor Scene Analysis , 1988 .

[77]  R.T. Farouki,et al.  The approximation of non-degenerate offset surfaces , 1986, Comput. Aided Geom. Des..

[78]  Jake K. Aggarwal,et al.  Determining motion parameters using intensity guided range sensing , 1986, Pattern Recognit..

[79]  Olivier D. Faugeras,et al.  Building visual maps by combining noisy stereo measurements , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[80]  Charles E. Thorpe,et al.  The CMU rover and the FIDO vision navigation system , 1983 .

[81]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[82]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[83]  H. P.,et al.  Differential Geometry of Three Dimensions , 1930, Nature.

[84]  Tomás Lozano-Pérez,et al.  An algorithm for planning collision-free paths among polyhedral obstacles , 1979, CACM.

[85]  M. Spivak A comprehensive introduction to differential geometry , 1979 .

[86]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[87]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[88]  J. Tukey,et al.  The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data , 1974 .

[89]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[90]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[91]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[92]  Thomas A. Foley,et al.  Weighted bicubic spline interpolation to rapidly varying data , 1987, TOGS.

[93]  N. Nandhakumar,et al.  Synergetic Integration Of Thermal And Visual Images For Computer Vision , 1987, Other Conferences.

[94]  AZRIEL ROSENFELD,et al.  Digital Straight Line Segments , 1974, IEEE Transactions on Computers.

[95]  R. Bajcsy,et al.  Three dimensional object representation revisited , 1987 .

[96]  P. Dierckx An algorithm for least-squares fitting of cubic spline surfaces to functions on a rectilinear mesh over a rectangle , 1977 .

[97]  W. L. Burke Applied Differential Geometry , 1985 .

[98]  Matthew Turk,et al.  VITS-A Vision System for Autonomous Land Vehicle Navigation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[99]  Ramesh C. Jain,et al.  Spline-based surface fitting on range images for CAD applications , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[100]  W. Mauch,et al.  Contents , 2007, European Neuropsychopharmacology.

[101]  T. Kanade,et al.  The Theory of Straight Homogeneous Generalized Cylinders , 1983 .

[102]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[103]  A. Lent,et al.  An introduction to NMR imaging: From the Bloch equation to the imaging equation , 1983, Proceedings of the IEEE.

[104]  Nabih N. Abdelmalek L1 solution of overdetermined systems of linear equations , 1980, TOMS.

[105]  Shuichi Tanaka,et al.  A rule-based approach to binocular stereopsis , 1988 .

[106]  Frank P. Ferrie,et al.  Deriving course 3D models of objects , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[107]  Allen R. Martin,et al.  Principal patches for computational geometry , 1982 .

[108]  E. Giusti On the equation of surfaces of prescribed mean curvature , 1978 .

[109]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[110]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[111]  R.H.T. Bates,et al.  Overview of computerized tomography with emphasis on future developments , 1983, Proceedings of the IEEE.

[112]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[113]  E. Krotkov,et al.  Cooperative focus and stereo ranging , 1988, [1988] Proceedings. The Fourth Conference on Artificial Intelligence Applications.

[114]  Anil K. Jain,et al.  EVIDENCE-BASED 3D VISION SYSTEM FOR RANGE IMAGES. , 1987 .

[115]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[116]  Ruzena Bajcsy,et al.  Adaptive Image Segmentation , 1988 .

[117]  Minsoo Suk,et al.  New measures of similarity between two contours based on optimal bivariate transforms , 1984, Comput. Vis. Graph. Image Process..

[118]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[119]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[120]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[121]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[122]  T. J. Willmore,et al.  An introduction to differential geometry , 1961 .

[123]  Jake K. Aggarwal,et al.  Image Processing Techniques for the Estimation of Drop Size Distributions , 1985 .

[124]  R. Haralick,et al.  A facet model for image data , 1981 .

[125]  Anil K. Jain,et al.  Surface classification: hypothesis testing and parameter estimation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[126]  John R. Kender,et al.  Information Based Complexity Applied to Optimal Recovery of the 2 1/2-D Sketch , 1985 .

[127]  大田 友一,et al.  Knowledge-based interpretation of outdoor natural color scenes , 1985 .

[128]  David B. Cooper,et al.  Bayesian Recognition of Local 3-D Shape by Approximating Image Intensity Functions with Quadric Polynomials , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[129]  Takeo Kanade,et al.  Incremental Reconstruction of 3D Scenes from Multiple, Complex Images , 1986, Artif. Intell..

[130]  M. Powell,et al.  Approximation theory and methods , 1984 .

[131]  E. R. Haddow,et al.  A parallel binocular stereo algorithm utilizing dynamic programming and relaxation labelling , 1987 .

[132]  D. Thomson,et al.  Robust-resistant spectrum estimation , 1982, Proceedings of the IEEE.

[133]  Larry H. Matthies,et al.  Integration of sonar and stereo range data using a grid-based representation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[134]  Berthold K. P. Horn Extended Gaussian images , 1984, Proceedings of the IEEE.

[135]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[136]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[137]  Morgan Kaufmnn Publid 3-D VISION FOR OUTDOOR NAVIGATION BY AN AUTONOMOUS VEHICLE , 1988 .

[138]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[139]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[140]  M. Livingstone Art, illusion and the visual system. , 1988, Scientific American.

[141]  Ronald Goldman Two Approaches to a Computer Model for Quadric Surfaces , 1983, IEEE Computer Graphics and Applications.

[142]  W. Eric L. Grimson,et al.  Discontinuity detection for visual surface reconstruction , 1985, Comput. Vis. Graph. Image Process..

[143]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[144]  Larry S. Davis,et al.  A new class of edge-preserving smoothing filters , 1987, Pattern Recognit. Lett..

[145]  B. Tversky,et al.  Objects, parts, and categories. , 1984 .

[146]  Jezekiel Ben-Arie,et al.  3-D OBJECTS RECOGNITION BY STATE SPACE SEARCH , 1986 .

[147]  David J. Burr,et al.  Elastic Matching of Line Drawings , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[148]  Carl Friedrich Gauss Disquisitiones generales circa superficies curvas , 1981 .

[149]  R. Bajcsy,et al.  Shape recovery and segmentation with deformable part models , 1987 .

[150]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[151]  Terrance E. Boult,et al.  The integration of information from stereo and multiple shape-from-texture cues , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[152]  PotmesilMichael Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987 .

[153]  Ernest L. Hall,et al.  Measuring Curved Surfaces for Robot Vision , 1982, Computer.

[154]  P. Giblin,et al.  Curves and Singularities , 1984 .

[155]  S. Chern A Proof of the Uniqueness of Minkowski's Problem for Convex Surfaces , 1957 .

[156]  Jake K. Aggarwal,et al.  AnEmpirical Evaluation ofGeneralized Cooccurrence Matrices , 1981 .

[157]  Birch B. Jeffrey Some convergence properties of iterated reweighted least squares in the location model , 1980 .