A high accuracy flow segmentation method in crowded scenes based on streakline

Abstract Flow segmentation based on similar motion patterns in crowded scenes remains an open problem in computer vision due to inherent complexity and vast diversity found in such scenes. To solve this problem, the streakline framework based on Lagrangian fluid dynamics had been proposed recently. However, this framework computed optical flow field using conventional optical flow method (Lucas Kanade method) which has poor anti-interference performance, and serious deviation would be brought to the computation of optical flow field. Moreover, our experimental results show that using the formulation of streak flow similarity in this framework can result in incorrect flow segmentation. Therefore, we combine this framework with a high accurate variational model, and modify the corresponding formulation of streak flow similarity after analyzing the streakline framework in detail. Finally, an improved method is proposed to solve flow segmentation in crowded scenes. Experiments are done to compare these two methods and results verify the validity and accuracy of our method.