Three-dimensional region matching and tracking in a long binocular image sequence

In this paper, a new approach to the tracking and matching processes is proposed. These two usually distinct operations are merged into a single one. The two binocular image sequences are seen as being a unique entity. This is done by using a clustering-based approach. We discuss about the determination of the best fitted invariant 3D region descriptors and the corresponding feature space. An optimal configuration of the binocular system is deduced from these considerations. This tracking and matching strategy allows the simultaneous processing of 2 X N binocular frames and the handling of occlusions phenomena and nonrigid motion segmentation and object deformation.