Stereo vision-based target tracking system for USV operations

Abstract A stereovision based methodology to estimate the position, speed and heading of a moving marine vehicle from a pursuing unmanned surface vehicle (USV) is considered, in support of enabling a USV to follow a target vehicle in motion. The methodology involves stereovision ranging, object detection and tracking, and minimization of tracking error due to image quantization limitations and pixel miscorrespondences in the stereo pixel-matching process. The method consists of combining a simple stereovision-matching algorithm, together with a predictive-corrective approach based on an extended Kalman filter (EKF), and use of suitable choices of probabilistic models representing the motion of the target vehicle and the stereovision measurements. Simple matching algorithms perform faster at the expense of potential errors in depth measurement. The approach considered aims to minimize the tracking errors related to such errors in stereovision measurements, thereby improving the accuracy of the state estimation of the vehicle. Results from simulations and a real-time implementation reveal the effectiveness of the system to compute accurate estimates of the state of the target vehicle over non-compliant trajectories subjected to a variety of motion conditions.

[1]  Terrance L. Huntsberger,et al.  Stereo vision–based navigation for autonomous surface vessels , 2011, J. Field Robotics.

[2]  Arijit Sinharay,et al.  Stereo Vision Based Pedestrians Detection and Distance Measurement for Automotive Application , 2011, 2011 Second International Conference on Intelligent Systems, Modelling and Simulation.

[3]  Verfassung der Arbeit,et al.  Robust Object Tracking Based on Tracking-Learning-Detection , 2012 .

[4]  Saied Moezzi,et al.  Dynamic stereo vision , 1992 .

[5]  A. Broggi,et al.  Pedestrian localization and tracking system with Kalman filtering , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[6]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[7]  Satyandra K. Gupta,et al.  Dynamics-aware target following for an autonomous surface vehicle operating under COLREGs in civilian traffic , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[10]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[11]  Arpan Pal,et al.  A Kalman Filter Based Approach to De-noise the Stereo Vision Based Pedestrian Position Estimation , 2011, 2011 UkSim 13th International Conference on Computer Modelling and Simulation.

[12]  Fernando Seco Granja,et al.  A Short-Range Ship Navigation System Based on Ladar Imaging and Target Tracking for Improved Safety and Efficiency , 2009, IEEE Transactions on Intelligent Transportation Systems.

[13]  Jacoby Larson,et al.  Advances in Autonomous Obstacle Avoidance for Unmanned Surface Vehicles , 2007 .

[14]  Sang Uk Lee,et al.  Illumination and camera invariant stereo matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jacoby Larson,et al.  Autonomous navigation and obstacle avoidance for unmanned surface vehicles , 2006, SPIE Defense + Commercial Sensing.

[16]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[17]  Thor I. Fossen,et al.  Guidance and control of ocean vehicles , 1994 .

[18]  Larry Matthies,et al.  Stereo vision and rover navigation software for planetary exploration , 2002, Proceedings, IEEE Aerospace Conference.

[19]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Han Wang,et al.  Improvement in real-time obstacle detection system for USV , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[21]  Han Wang,et al.  A vision-based obstacle detection system for Unmanned Surface Vehicle , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).

[22]  S. Shafer,et al.  Dynamic stereo vision , 1989 .

[23]  John J. Leonard,et al.  Autonomy through SLAM for an Underwater Robot , 2009, ISRR.

[24]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[26]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.