High-Accuracy Recognition and Localization of Moving Targets in an Indoor Environment Using Binocular Stereo Vision

To obtain effective indoor moving target localization, a reliable and stable moving target localization method based on binocular stereo vision is proposed in this paper. A moving target recognition extraction algorithm, which integrates displacement pyramid Horn–Schunck (HS) optical flow, Delaunay triangulation and Otsu threshold segmentation, is presented to separate a moving target from a complex background, called the Otsu Delaunay HS (O-DHS) method. Additionally, a stereo matching algorithm based on deep matching and stereo vision is presented to obtain dense stereo matching points pairs, called stereo deep matching (S-DM). The stereo matching point pairs of the moving target were extracted with the moving target area and stereo deep matching point pairs, then the three dimensional coordinates of the points in the moving target area were reconstructed according to the principle of binocular vision’s parallel structure. Finally, the moving target was located by the centroid method. The experimental results showed that this method can better resist image noise and repeated texture, can effectively detect and separate moving targets, and can match stereo image points in repeated textured areas more accurately and stability. This method can effectively improve the effectiveness, accuracy and robustness of three-dimensional moving target coordinates.

[1]  Aggelos K. Katsaggelos,et al.  A Theory for the Optimal Bit Allocation Between Displacement Vector Field and Displaced Frame Difference , 1997, IEEE J. Sel. Areas Commun..

[2]  Xiangjun Zou,et al.  Localisation of litchi in an unstructured environment using binocular stereo vision , 2016 .

[3]  Mingyu Gao,et al.  Vision System of Mobile Robot Combining Binocular and Depth Cameras , 2017, J. Sensors.

[4]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  Mario Manzo Graph-Based Image Matching for Indoor Localization , 2019, Mach. Learn. Knowl. Extr..

[7]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[8]  Cordelia Schmid,et al.  DeepMatching: Hierarchical Deformable Dense Matching , 2015, International Journal of Computer Vision.

[9]  Camillo J. Taylor,et al.  Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames , 2015, EMMCVPR.

[10]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[11]  Paolo Barsocchi,et al.  Localising crowds through Wi-Fi probes , 2018, Ad Hoc Networks.

[12]  Qiang Huang,et al.  Design and implementation of an omnidirectional vision system for robot perception , 2017 .

[13]  Eduardo Alonso,et al.  Data-driven Recovery of Hand Depth using Conditional Regressive Random Forest on Stereo Images , 2018 .

[14]  Daniel Cremers,et al.  An Improved Algorithm for TV-L 1 Optical Flow , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[15]  Michael J. Black,et al.  A Naturalistic Open Source Movie for Optical Flow Evaluation , 2012, ECCV.

[16]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.