Chapter 5 – Video Indexing

Publisher Summary This chapter focuses on video indexing. The basic video indexing task is to find objects in the search space that match the query object. The indexing task requires each object to have a consistent description and a similarity metric that helps establish how closely any two descriptions match. This chapter focuses on the descriptions based on low-level video and audio features. Video indexing lends itself to low and high-level feature-based approaches. The video indexing community has diligently examined the entire range of available low-level features and obtained interesting results. Evidence indicates that video indexing needs to bridge the gap between low-level features and content semantics to make a significant impact, both scientifically and technologically. This chapter concludes that audio features are a rich source of content semantics. Audio data consume much less bandwidth compared to video data, and audio classification enables much easier access to content semantics than visual analysis.