Detecting moving objects from a video taken by a moving camera using sequential inference of background images

This paper proposes a method of detecting moving objects using sequential inference of the background in a video taken with a moving camera. In the video taken using a moving camera, all positions of pixels change every frame. The positions of the background pixels in the image frame T are not the same as the positions of the background pixels in the image frame T + 1. 2D projective transform can be used to find changes in the pixel position every frame. Bilinear interpolation with four nearest pixels around the pixel in image frame T which corresponds to a pixel in the image frame T+1 can be used for creating a background model at T + 1. Having obtained the background model, a pixel in image frame T + 1 can be determined if it is a background pixel or a foreground pixel. The detection results of the proposed method are compared with the ground truth to determine the effectiveness of the proposed method.