Shared-bed person segmentation based on motion estimation

Video-based sleep analysis is a topic with important applications, and shared-bed occurs frequently in the context of sleep. One difficulty for the shared-bed situation is to assign the movements to the correct person because they can occur in close proximity and even overlapping. To manage to achieve person segmentation in the shared-bed situation, in this paper we propose an approach to correctly segment the region of persons based on motion estimation. In our approach, considering the consistency of the motion vectors, specifically their length and angle, the adjacent blocks are clustered. The generated clusters are then assigned to a person according to temporal correlation. The occupied region of the person is updated each frame based on the assignment result of the clusters. The proposed approach tackles the segmentation issue when the two persons are close to each other or even overlap, and the accuracy of the segmentation is beyond 82% in the data set we acquired.

[1]  K. P. Chow,et al.  Efficient Block-based Motion Segmentation Method using Motion Vector Consistency , 2005, MVA.

[2]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[3]  A. Murat Tekalp,et al.  Region-Based Parametric Motion Segmentation Using Color Information , 1998, Graph. Model. Image Process..

[4]  Marcel Worring,et al.  Detection of moving objects in video using a robust motion similarity measure , 2000, IEEE Trans. Image Process..

[5]  S. Padmakala,et al.  A Novel Video Object Segmentation Approach for Noisy Video Sequences towards Effective Video Retrieval , 2010 .

[6]  Lior Wolf,et al.  Two-body segmentation from two perspective views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Filiberto Pla,et al.  Motion-based segmentation and region tracking in image sequences , 2001, Pattern Recognit..

[8]  Andrea Fusiello,et al.  Segmentation and tracking of multiple video objects , 2007, Pattern Recognit..

[9]  D. Lee,et al.  Computer Vision-Based Human Body Segmentation and Posture Estimation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.