Structural motion segmentation for compact image sequence representation

This paper addresses a problem of extraction of the structural motion information for compact image sequence representation. In order to extract a meaningful scene structure from image sequence, global motion and region shape of moving objects are taken into consideration. Firstly, intraframe segmentation is carried out with edges that are detected from zero-crossings of a wavelet transform, and local motions are estimated using a gradient-based method. Moving regions are then extracted using the local motion based on the intraframe segmentation. Secondly, moving regions are roughly separated into the region of the moving objects based on probabilistic clustering with mixture models using the optical flow and the image intensity for each region of the intraframe segmentation. Motion segmentation can finally be obtained by iterated estimation of affine motion parameters and region reassignment according to a criterion using Gauss-Newton iterative optimization algorithm.