Early vision: From computational structure to algorithms and parallel hardware

I review a new theoretical framework that from the computational nature of early vision leads to algorithms for solving them and suggests a specific class of appropriate hardware. The common computational structure of many early vision problems is that they are mathematically ill-posed in the sense of Hadamard. Standard regularization analysis can be used to solve them in terms of variational principles that enforce constraints derived from a physical analysis of the problem, see T. Poggio and V. Torre (Artificial Intelligence Lab. Memo No. 773, MIT, Cambridge, Mass., 1984). Studies of human perception may reveal whether some principles of a similar type are exploited by biological vision. It can also be shown that the corresponding variational principles are implemented in a natural way by analog networks, see T. Poggio and C. Koch (Artificial Intelligence Lab. Memo No. 783, MIT, Cambridge, Mass., 1984). Specific electrical and chemical networks for localizing edges and computing visual motion are derived. These results suggest that local circuits of neurons may exploit this unconventional model of computation.

[1]  T. Poggio,et al.  A theoretical analysis of electrical properties of spines , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  W. Karplus,et al.  Analog simulation : solution of field problems , 1961 .

[3]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[4]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[5]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[7]  Ellen C. Hildreth,et al.  Implementation Of A Theory Of Edge Detection , 1980 .

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[10]  W E Grimson,et al.  A computational theory of visual surface interpolation. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[12]  P. Dev,et al.  Electrotonic processing of information by brain cells. , 1976, Science.

[13]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[15]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  A. G. J. MacFarlane,et al.  Dynamical system models , 1970 .

[17]  Gabriel Kron,et al.  Electric Circuit Models of the Schrödinger Equation , 1945 .

[18]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[19]  S. Ullman The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  H. Busse,et al.  Information Transmission in a Diffusion-Coupled Oscillatory Chemical System , 1973, Nature.

[21]  J. Canny Finding Edges and Lines in Images , 1983 .

[22]  T. Poggio,et al.  Ill-Posed Problems and Regularization Analysis in Early Vision , 1984 .

[23]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[24]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[25]  M. Nashed Approximate regularized solutions to improperly posed linear integral and operator equations , 1974 .

[26]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[27]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[28]  S. Ellias,et al.  The dendritic varicosity: a mechanism for electrically isolating the dendrites of cat retinal amacrine cells? , 1980, Brain Research.

[29]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  Alan L. Yuille,et al.  An Extremum Principle for Shape from Contour , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  C. Reinsch Smoothing by spline functions , 1967 .

[32]  Tomaso Poggio,et al.  A Theory of Human Stereo Vision , 1977 .

[33]  G. Wahba Ill Posed Problems: Numerical and Statistical Methods for Mildly, Moderately and Severely Ill Posed Problems with Noisy Data. , 1980 .

[34]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[35]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[36]  Benjamin C. Kuo,et al.  Linear networks and systems , 1967 .

[37]  W. Eric L. Grimson,et al.  Shape Encoding and Subjective Contours , 1980, AAAI.

[38]  JOHN W. Moore Membranes, ions, and impulses , 1976 .

[39]  C. Desoer,et al.  Tellegen's theorem and thermodynamic inequalities. , 1971, Journal of theoretical biology.

[40]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[41]  M. Kac Can One Hear the Shape of a Drum , 1966 .

[42]  Demetri Terzopoulos,et al.  Multiresolution computation of visible-surface representations , 1984 .

[43]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Alan L. Yuille The Smoothest Velocity Field Token Matching Schemes , 1984, ECAI.

[45]  E. Marder Mechanisms underlying neurotransmitter modulation of a neuronal circuit , 1984, Trends in Neurosciences.

[46]  Ilya Prigogine,et al.  Thermodynamics of Irreversible Processes , 2018, Principles of Thermodynamics.

[47]  J. K. Moser,et al.  A theory of nonlinear networks. I , 1964 .

[48]  E. Hildreth The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[49]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[50]  E. Renshaw,et al.  STOCHASTIC DIFFERENTIAL EQUATIONS , 1974 .

[51]  Geoffrey E. Hinton,et al.  OPTIMAL PERCEPTUAL INFERENCE , 1983 .

[52]  D. Luenberger Optimization by Vector Space Methods , 1968 .