Tracking and graph-cut based approach for panoramic background construction

Abstract. An efficient method is presented for extracting motion behaviors and contours of moving objects in a wide view and for creating panoramic background. In the field of making panorama, the main goal of existing methods is to create a pleasing wide view. For this purpose, such methods do not track moving objects. They attempt to find optimal seams so that the result does not contain cut objects or blurring. Hence, moving objects are removed, repeated, or placed in an arbitrary location in the final panoramic image. We expand panorama applications from artistic views to surveillance usages. To investigate moving object behavior, the proposed method attempts to find correspondences between positions of a moving object in different selected frames by using SIFT features. It also presents a new approach to combine various types of information in order to extract the exact boundary of moving objects in moving cameras. The required information is obtained from the moving object’s corresponding areas in other frames. Experiments were arranged to demonstrate the effectiveness and robustness of this method. The results show that this method, which uses fewer frames, is able to create better panoramic background compared with the existing methods.