A New Method of Stereo Localization Using Dual-PTZ-Cameras

To improve the localization accuracy and robustness of the moving 3D-target under the nature scenes, we propose a new target localization method through combining MSER (Maximally Stable Extremal Region) detector with SIFT (Scale Invariant Feature Transform) descriptor into the dual-PTZ-cameras stereo vision system. Firstly, stereo vision rectification is performed on the right-and-left images captured from the dual-PTZ-cameras with different focal lengths using designed Look-up-table(LUT )and BP neural network. Secondly, more high quality affine invariant features are extracted from the rectified images to perform initial matching using affine invariant feature detector and descriptor. Thirdly, erroneous correspondences is detected by RANSAC. Then, robust features matching under the multi-view-point and multi-focal-length is achieved. The localization experimental results of the moving 3-D target in a complex environment show that the proposed method has good localization accuracy and robustness.

[1]  GU Wei-kang Binocular Stereo Vision System Based on FPGA , 2005 .

[2]  Gian Luca Foresti,et al.  Stereo rectification of uncalibrated and heterogeneous images , 2010, Pattern Recognit. Lett..

[3]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[6]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[7]  Claudio Piciarelli,et al.  Stereo Localization Using Dual PTZ Cameras , 2009, CAIP.

[8]  Robin Kalia,et al.  Image matching with SIFT descriptor on affine normalized MSERs , 2011, 2011 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  David G. Lowe,et al.  Shape Descriptors for Maximally Stable Extremal Regions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Gian Luca Foresti,et al.  Stereo Localization Based on Network's Uncalibrated Camera Pairs , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.