Video Segmentation Based on Spatial-Temporal Attention Model

Focusing on segmentation error existed in video segmentation algorithms under the complicated and dynamic background, spatial-temporal feature is proposed and can be extracted through significant mapping. Video segmentation is modeled using hierarchical conditional random field. In this algorithm, temporal relative motion characteristics and spatial color characteristics are used to construct the significant mapping. In accordance with the visual psychology theory, the moving objects and static background are separated roughly. Then Gaussian mixture model is used to establish the energy functions of foreground and background. The super-pixel is used to define the adjacent energy function, which binds relevance among the adjacent context. Finally, the hierarchical conditional random field model is used to solve these features energy functions under constraints in order to gain the final segmentation results. The experiments show that the algorithm will be effect and stable even under complex and dynamical background. KeywordsVideo segmentation, spatial-temporal feature, significant mapping, hierarchical conditional random field