The automatic real-time analysis of film editing and transition effects and its applications

Abstract We describe an adaptive method for the automatic analysis of film editing. Unlike previously proposed methods, which were restricted to the detection of cut transitions between sequence shots, our method achieves detection of shot change even when done through smooth transition effects (dissolves, wipes), and identifies classes of transition special effects. This method can be applied in real-time on a flow of digital or analog motion picture data of any resolution. We describe experimental implementations of the method. Applications of such a tool are the temporal analysis of motion picture data to be stored in large databases and the automatic choice of entry points in compressed motion picture. The fact that the analysis can be done in real-time allows for its use at digitizing time, or on the output of a video production site. Temporal analysis and description of motion picture is presently a major time and money bottleneck in the establishment of motion picture databases, and we argue that our method can significantly improve the situation in this field.