A Society of Models for Video and Image Libraries

The average person with a computer will soon have access to the world's collections of digital video and images. However, unlike text that can be alphabetized or numbers that can be ordered, image and video has no general language to aid in its organization. Tools that can "see" and "understand" the content of imagery are still in their infancy, but they are now at the point where they can provide substantial assistance to users in navigating through visual media. This paper describes new tools based on "vision texture" for modeling image and video. The focus of this research is the use of a society of low-level models for performing relatively high-level tasks, such as retrieval and annotation of image and video libraries. This paper surveys recent and present research in this fast-growing area.

[1]  Kris Popat,et al.  Analysis and synthesis of sound textures , 1998 .

[2]  E. Ben-Jacob,et al.  The formation of patterns in non-equilibrium growth , 1990, Nature.

[3]  Rosalind W. Picard,et al.  Color halftoning with M-lattice , 1995, Proceedings., International Conference on Image Processing.

[4]  Joseph M. Francos,et al.  A unified texture model based on a 2-D Wold-like decomposition , 1993, IEEE Trans. Signal Process..

[5]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[6]  Rosalind W. Picard.  Affective Computing , 1997 .

[7]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Rama Chellappa,et al.  Classification of textures using Markov random field models , 1984, ICASSP.

[9]  G. O'Donoghue,et al.  Spatial yield modeling for semiconductor wafers , 1995, Proceedings of SEMI Advanced Semiconductor Manufacturing Conference and Workshop.

[10]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  Rosalind W. Picard,et al.  Texture orientation for sorting photos "at a glance" , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[13]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.

[15]  Kris Popat,et al.  Novel cluster-based probability model for texture synthesis, classification, and compression , 1993, Other Conferences.

[16]  Louis Garand,et al.  A Structural-Stochastic Model for the Analysis and Synthesis of Cloud Images , 1986 .

[17]  G. Reeke.  Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[18]  Andrew Witkin,et al.  Reaction-diffusion textures , 1991, SIGGRAPH.

[19]  M. Hassner,et al.  The Use of Markov Random Fields as Models of Texture , 1981 .

[20]  A.S. Sherstinsky,et al.  M-lattice: from morphogenesis to image processing , 1996, IEEE Trans. Image Process..

[21]  Rama Chellappa,et al.  Texture synthesis and compression using Gaussian-Markov random field models , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[23]  R. Herrnstein,et al.  Natural concepts in pigeons. , 1976, Journal of experimental psychology. Animal behavior processes.

[24]  M. Wakita,et al.  Pigeons' discrimination of paintings by Monet and Picasso. , 1995, Journal of the experimental analysis of behavior.

[25]  Rosalind W. Picard.  Light-years from Lena: video and image libraries of the future , 1995, Proceedings., International Conference on Image Processing.

[26]  Alex Pentland,et al.  Temperature and Gibbs Image Modeling , 1995 .

[27]  TurkGreg.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991 .

[28]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[29]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[30]  Atreyi Kankanhalli,et al.  A Video Database System for Digital Libraries , 1994, DL.

[31]  Ibrahim M. Elfadel,et al.  Gibbs Random Fields, Cooccurrences, and Texture Modeling , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .

[33]  Rosalind W. Picard.  Structured patterns from random fields , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[34]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[35]  Alexander Semyon Sherstinsky,et al.  M-lattice: a system for signal synthesis and processing based on reaction-diffusion , 1994 .

[36]  Rosalind W. Picard,et al.  Synthesizing Flames and their Spreading , 1994 .

[37]  Nicolas Saint-Arnaud.  Classification of sound textures , 1995 .

[38]  Ajai Jain,et al.  The Handbook of Pattern Recognition and Computer Vision , 1993 .

[39]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[41]  A. Ravishankar Rao,et al.  Identifying High Level Features of Texture Perception , 1993, CVGIP Graph. Model. Image Process..

[42]  Tom Minka,et al.  Interactive learning with a "Society of Models" , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Patrick Wambacq,et al.  Applications of reaction-diffusion equations to image processing , 1989 .

[44]  Tanveer F. Syeda-Mahmood.  Model-driven Selection using Texture , 1993, BMVC.

[45]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[46]  Kris Popat,et al.  Cluster-based probability model and its application to image and texture processing , 1997, IEEE Trans. Image Process..

[47]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[48]  Rosalind W. Picard,et al.  Finding perceptually dominant orientations in natural textures. , 1994, Spatial vision.

[49]  Rosalind W. Picard.  Toward a Visual Thesaurus , 1995, MIRO.

[50]  N. Rashevsky,et al.  Mathematical biology , 1961, Connecticut medicine.

[51]  F. S. Cohen,et al.  Classification of Rotated and Scaled Textured Images Using Gaussian Markov Random Field Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[53]  W. Millard.  Species preferences of experimenters: Journal of the Experimental Analysis of Behavior. , 1976 .

[54]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[55]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.