System and method for video content analysis

Video analysis system and methods described herein generally includes a video encoder, the video encoder acts to generate macro block video analytics metadata (the VAMD) from the video frame. VAMD function receives video frames and encoded version of the video frame and is configured to use VAMD generate video and the encoded analysis information associated with the frame. VAMD downstream decoder may use to obtain the global motion vector associated with the frame, the detection and tracking of moving objects in the frame and monitors the frame provides a line or discovered. VAMD may use information in the detected object is moved linearly across the cross-traverse and counts the number of times, and the line may be part of the encoded frame in a region being monitored polygon drawing. VAMD may comprise the macroblock level information and video frame level.