A Case Study in Video Parsing: Television News

Automatic extraction of “semantic” information of general video programs is outside the capability of current machine vision and audio signal analysis technologies. On the other hand “content parsing” may be possible when one has an a priori model of a video’s structure based on domain knowledge. Such a model may represent a strong spatial order within the individual images and/or a strong temporal order across a sequence of shots. A television news program is a good example of a video which follows such a structural model: there tends to be spatial structure within the anchorperson shots and temporal structure in the order of shots and episodes.

[1]  G. Edelman.  Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[2]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[3]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[4]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[5]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[6]  C. J. Date,et al.  An introduction to database systems (The systems programming series) , 1975 .

[7]  David Drucker,et al.  Quicktime Handbook , 1992 .

[8]  John S. Boreczky,et al.  Indexes for user access to large video databases , 1994, Electronic Imaging.

[9]  Avron Barr,et al.  The Handbook of Artificial Intelligence, Volume 1 , 1982 .

[10]  Norman I. Badler,et al.  Digital Representations of Human Movement , 1979, CSUR.

[11]  Yoshinobu Tonomura,et al.  VideoMAP and VideoSpaceIcon: tools for anatomizing video content , 1993, INTERCHI.

[12]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[13]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[14]  Fang Liu,et al.  Periodicity, directionality, and randomness: Wold features for perceptual pattern recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[15]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[16]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[17]  Azriel Rosenfeld,et al.  Computer Methods in Image Analysis , 1977 .

[18]  Stephen W Smoliar.  On the promises of multimedia authoring , 1994, Inf. Softw. Technol..

[19]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[20]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[21]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[22]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[23]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[24]  R. Nowak,et al.  Walker's mammals of the world , 1968 .

[25]  Eric Gidney,et al.  CSCW for film and TV preproduction , 1994, IEEE MultiMedia.

[26]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[27]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[28]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[29]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[30]  Din-Chang Tseng,et al.  Color segmentation using perceptual attributes , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[31]  Brian C. O'Connor,et al.  Selecting Key Frames of Moving Image Documents: A Digital Environment for Analysis and Navigation. , 1991 .

[32]  Fang Liu,et al.  Real-time recognition with the entire Brodatz texture database , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Nicholas J. Belkin,et al.  Information filtering and information retrieval: two sides of the same coin? , 1992, CACM.

[34]  Aguierre Smith,et al.  If you could see what I mean : descriptions of video in an anthropologist's video notebook , 1992 .

[35]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[36]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[37]  Edward H. Adelson,et al.  MECHANISMS FOR MOTION PERCEPTION , 1991 .

[38]  Yihong Gong,et al.  Video parsing using compressed data , 1994, Electronic Imaging.

[39]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[40]  Atreyi Kankanhalli,et al.  A Video Database System for Digital Libraries , 1994, DL.

[41]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[42]  Marc Davis,et al.  Media Streams: an iconic visual language for video annotation , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[43]  Shi-Kuo Chang,et al.  Principles of pictorial information systems design , 1988 .

[44]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Terry E. Weymouth,et al.  Semantic Queries with Pictures: The VIMSYS Model , 1991, VLDB.

[46]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[47]  Yoshinobu Tonomura,et al.  Video handling based on structured information for hypermedia systems , 1991 .

[48]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[49]  Dennis McLeod,et al.  Abstraction in databases , 1980, Workshop on Data Abstraction, Databases and Conceptual Modelling.

[50]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[51]  Suliman Al-Hawamdeh,et al.  Image Information Retrieval Systems , 1993, Handbook of Pattern Recognition and Computer Vision.

[52]  Lawrence Hunter,et al.  Knowledge acquisition planning: gaining expertise through experience , 1989 .

[53]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[54]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[55]  Forouzan Golshani,et al.  Rx for semantic video database retrieval , 1994, MULTIMEDIA '94.

[56]  R. M. Siegel,et al.  Foundations of Cognitive Science , 1990, Journal of Cognitive Neuroscience.

[57]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[58]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[59]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[60]  William A. Pearlman,et al.  Texture coding using a Wold decomposition model , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 2 - Conference B: Computer Vision & Image Processing. (Cat. No.94CH3440-5).

[61]  Ramanathan V. Guha,et al.  Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project , 1990 .

[62]  Yihong Gong,et al.  Effective method for detecting regions of given colors and the features of the region surfaces , 1994, Electronic Imaging.

[63]  Michael Hawley.  Structure out of sound , 1993 .

[64]  Suliman Al-Hawamdeh,et al.  Nearest neighbour searching in a picture archive system , 1991 .

[65]  Barr and Feigenbaum Edward A. Avron,et al.  The Handbook of Artificial Intelligence , 1981 .

[66]  A. Khotanzad,et al.  Feature selection for texture recognition based on image synthesis , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[67]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[68]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[69]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Other Conferences.

[70]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.