Image Structure

notation: A = {F, </>}. In sloppy form: A = J dx f (x) </>( x). Samples are always finite, as opposed to point values of the underlying source field. Apart from this they may be positive, zero, or negative. A positive sample does not imply positivity of the underlying source field; a source is positive if all samples obtained by positive definite detectors tum out positive. If we want to compare different samples, we have to gauge our detectors by a conventional normalisation. For the moment we will require neither positivity nor normalisation. Since Definition 3.1 claims to define a local sample, we have to be able to tell what its base point is. In order to do so we need an explicit definition of a projection map 7r : ~ -+ M which associates each detector element </> E ~ with its corresponding base point x = 7r[</>]. This in tum assumes that we can perceive of ~ as a "bundle" of local device spaces ~x, comprising one "fibre" for each base point: ~ = UxEM~x' The inverse image 7r1(x) of a base point x is, by definition, the entire local device space ~x at that point. A local state space ~x is then established as the physical degrees of freedom probed by a local device space ~x, i.e. "what we are looking at" with a localised detector. We will return to a precise definition of 7r in Section 3.9. For the moment it suffices to think of the base point as a the "centre of gravity" for the filter </>. The base point we would like to attribute to a sample is of course the one corresponding to the detector, but note that there is no way of telling from the value of a local sample "where it's at"; the geometric notion of a base point is established as an extrinsic detector property (a label). Obviously, local samples are obtained at finite resolution. Again, being a spatiotemporal property, resolution cannot be inferred from a sample's value, only 3.1 Local Samples 41 from its underlying aperture. A precise definition of the resolution of a local detector requires us to define a notion of extent or inner scale for that detector. A definition of inner scale will also be postponed until Section 3.9; think of it for the moment as the width of a central region, containing the filter's base point, where most of the filter's weight is concentrated (it is clearly not very useful to relate inner scale to detector support, since by construction this may be all of spacetime). See also Problem 3.2. We can consider the transformation (push forward) of a detector under an arbitrary spacetime automorphism, i.e. a "warping", or a smooth transformation of spacetime with smooth inverse. Definition 3.2 (Push Forward) Let () : M -t M : x 1-+ ()(x) be a smooth spacetime automorphism. The push forward of a filter is then defined as the mapping with Jacobian determinant J'X. == I det Vx I· This induces a natural, so-called pull back (also called "reciprocal image") of the source. Definition 3.3 (Pull Back) With the automorphism () and its push forward ()* as defined in Definition 3.2, the pull back of the source is defined as the mapping ()* : Eo(x) -t Ex : F 1-+ ()* F defined by ()* F[¢] ~f F[()*¢]. In sloppy form this states that ()* f == f 0 (), which physicists tend to refer to as "scalar field transformation" (Problem 3.3). Note that if ¢ lives at base point x, then its push forward ()*¢ is associated with the mapped point ()(x), which explains its name. Naturally, pull back works the other way around. Push forward and pull back are instances of a so-called" carry along" principle. If we have two communicating objects-i.c. sources plus detectors producing a response-then a change of either will in general be reflected in the output. Reversely, a given change in output can be explained as being caused by a change in either object. For example, shifting a patient underneath a scanner will have the same effect as moving the scanner in opposite sense over a stationary patient. This principle generalises to arbitrary deformations beyond rigid transformations (at least conceptually: one of the options is not necessarily in the interest of the patient). The idea is that at least one of these dual views is practicable and legitimate (e.g. processing scanner output). It would be formally more correct to attach base points to sources and detectors matching the labels of E and tl in Definitions 3.2 and 3.3, but that would yield rather cumbersome notations. There ought to be no confusion if we simply 42 Local Samples and Images keep in mind the following commutative diagram:

[1]  H. Grassmann Der Ort der Hamilton'schen Quaternionen in der Ausdehnungslehre , 1877 .

[2]  J. J. Fourier,et al.  The Analytical Theory of Heat , 1878, Nature.

[3]  Clifford,et al.  Applications of Grassmann's Extensive Algebra , 1878 .

[4]  D. Hilbert Ueber die vollen Invariantensysteme , .

[5]  J. Hadamard Sur les problemes aux derive espartielles et leur signification physique , 1902 .

[6]  E. Cartan Sur les variétés à connexion affine et la théorie de la relativité généralisée. (première partie) , 1923 .

[7]  H. L. Dryden,et al.  Investigations on the Theory of the Brownian Movement , 1957 .

[8]  G. Gibson The Thirteen Books of Euclid's Elements , 1927, Nature.

[9]  R. Hetherington The Perception of the Visual World , 1952 .

[10]  R. Feynman,et al.  Quantum Mechanics and Path Integrals , 1965 .

[11]  B. Dewitt QUANTUM THEORY OF GRAVITY. II. THE MANIFESTLY COVARIANT THEORY. , 1967 .

[12]  G. Shilov,et al.  Generalized Functions, Volume 1: Properties and Operations , 1967 .

[13]  Alan R. Jones,et al.  Fast Fourier Transform , 1970, SIGP.

[14]  V. Arnold Mathematical Methods of Classical Mechanics , 1974 .

[15]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[16]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[17]  D. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1979 .

[18]  R. Bishop,et al.  Tensor Analysis on Manifolds , 1980 .

[19]  Robert Gilmore,et al.  Catastrophe Theory for Scientists and Engineers , 1981 .

[20]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[21]  J. Galayda Edge Focusing , 1981, IEEE Transactions on Nuclear Science.

[22]  R. Abraham,et al.  Manifolds, Tensor Analysis, and Applications , 1983 .

[23]  D. Hestenes,et al.  Clifford Algebra to Geometric Calculus: A Unified Language for Mathematics and Physics , 1984 .

[24]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[25]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[26]  M. Friedman Foundations of space-time theories : relativistic physics and philosophy of science , 1986 .

[27]  Johan D'Haeyer Determining motion of image curves from local pattern changes , 1986, Comput. Vis. Graph. Image Process..

[28]  Jensen,et al.  Fractal measures and their singularities: The characterization of strange sets. , 1987, Physical review. A, General physics.

[29]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[31]  Rachid Deriche,et al.  Fast algorithms for low-level vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[32]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[33]  J. Michael Fitzpatrick,et al.  The existence of geometrical density-image transformations corresponding to object motion , 1988, Comput. Vis. Graph. Image Process..

[34]  Jens Arnspang,et al.  Optic Acceleration , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[35]  Christopher Heil,et al.  Continuous and Discrete Wavelet Transforms , 1989, SIAM Rev..

[36]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[37]  W. Fenchel Elementary Geometry in Hyperbolic Space , 1989 .

[38]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[39]  Olle Seger,et al.  Rotation Invariance in Gradient and Higher Order Derivative Detectors , 1990, Computer Vision Graphics and Image Processing.

[40]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Henk J. A. M. Heijmans,et al.  Theoretical Aspects of Gray-Level Morphology , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  D. Hestenes,et al.  Projective geometry with Clifford algebra , 1991 .

[43]  C. Chui Wavelets: A Tutorial in Theory and Applications , 1992 .

[44]  H. Harmuth Information theory applied to space-time physics , 1992 .

[45]  R. Benedetti,et al.  Lectures on Hyperbolic Geometry , 1992 .

[46]  Max A. Viergever,et al.  Families of Tuned Scale-Space Kernels , 1992, ECCV.

[47]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[48]  H.J.A.M. Heijmans,et al.  Mathematical morphology: a geometrical approach in image processing , 1992 .

[49]  B. Buck,et al.  An illustration of Benford's first digit law using alpha decay half lives , 1993 .

[50]  R. Deriche Recursively Implementing the Gaussian and its Derivatives , 1993 .

[51]  I. Daubechies Ten Lectures on Wavelets , 1992 .

[52]  Jens Arnspang,et al.  Motion constraint equations based on constant image irradiance , 1993, Image Vis. Comput..

[53]  Arnold W. M. Smeulders,et al.  Morphological multi-scale image analysis , 1993 .

[54]  Sundar C. Amartu,et al.  A new approach to study cardiac motion: The optical flow of cine MR images , 1993, Magnetic resonance in medicine.

[55]  R. Edelman,et al.  Clinical Magnetic Resonance Angiography , 1993 .

[56]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[57]  Jan J. Koenderink,et al.  Spatial Derivatives and the Propagation of Noise in Gaussian Scale Space , 1993, J. Vis. Commun. Image Represent..

[58]  Max A. Viergever,et al.  Deblurring Gaussian blur , 1994, Optics & Photonics.

[59]  R. Estrada,et al.  Introduction to the Theory of Distributions , 1994 .

[60]  Stephen D. Casey,et al.  Systems of Convolution Equations, Deconvolution, Shannon Sampling, and the Wavelet and Gabor Transforms , 1994, SIAM Rev..

[61]  M. Nielsen,et al.  The Intrinsic Structure of the Optic Flow Field , 1994 .

[62]  Leo Dorst,et al.  Morphological signal processing and the slope transform , 1994, Signal Process..

[63]  Arnold W. M. Smeulders,et al.  The Morphological Structure of Images: The Differential Equations of Morphological Scale-Space , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Max A. Viergever,et al.  Nonlinear scale-space , 1995, Image Vis. Comput..

[65]  A. Bakushinskii,et al.  Ill-Posed Problems: Theory and Applications , 1994 .

[66]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[67]  I. Ohzawa,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[68]  J. Damon Local Morse Theory for Solutions to the Heat Equation and Gaussian Blurring , 1995 .

[69]  M. Florack Grey-scale Images , 1995 .

[70]  Luc Van Gool,et al.  Vision and Lie's approach to invariance , 1995, Image Vis. Comput..

[71]  Alan C. F. Colchester,et al.  Superficial and deep structure in linear diffusion scale space: isophotes, critical points and separatrices , 1995, Image Vis. Comput..

[72]  Eduardo Bayro-Corrochano,et al.  Geometric algebra: a framework for computing point and line correspondences and projective structure using n uncalibrated cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[73]  O. F. Olsen Multi-Scale Segmentation of Grey-Scale Images , 1996 .

[74]  Feng Lin,et al.  Representations that uniquely characterize images modulo translation, rotation, and scaling , 1996, Pattern Recognit. Lett..

[75]  Bruce Fischl,et al.  Learning an Integral Equation Approximation to Nonlinear Anisotropic Diffusion in Image Processing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Henk J. A. M. Heijmans Composing morphological filters , 1997, IEEE Trans. Image Process..

[77]  L. Florack Measurement Duality , 1997 .