In recent years, the port occurred on many the theft cases that boats moored ships to implement embarkation at night, which seriously affected the economic benefits and the safety of the persons on the ship. In order to all-weather real-time monitor the condition around the ship, and to find the abnormal behavior of moving targets in time, the use of infrared video sensor is proposed for mooring the condition around the ship, and intelligent analysis for infrared video. First of all, through the semi-threshold method, Canny operator and connected component labeling for target detection, and to draw the target's movement track through the centroid coordinates, and then analyses the layout scheme of infrared video sensors, finally, determine whether the moving target near to the ship based on non-calibration binocular distance measurement, such as against by suspicion, alarm immediately. The experimental results show that this method is simple and effective, it can well realize to monitor the moving target in port, and to early warning at night.