Using full motion 3D Flash LIDAR video for target detection, segmentation, and tracking

It is now the case that well-performing flash LIDAR focal plane array devices are commercially available. Such devices give us the ability to measure and record registered 3D point cloud sequences at video frame rates. For target detection and tracking applications this allows the processes of structure from motion or multi-view stereo reconstruction to be circumvented. This allows us to construct simple and robust real-time 3D detection and tracking systems. The goal of this work is to demonstrate for the first time a proof-of-concept system using a commercial 3D Flash LIDAR camera. The system will accomplish the detection, segmentation, and tracking of human sized objects using a combination of fundamental point cloud processing algorithms. With marginal refinement efforts the result of this work is directly applicable to perimeter surveillance and site security.

[1]  Richard D. Richmond,et al.  Eye-safe laser radar 3D imaging , 2001, SPIE Defense + Commercial Sensing.

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[4]  John G. Harris,et al.  Rigid body motion from range image sequences , 1991, CVGIP Image Underst..

[5]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[6]  Hamid Gharavi,et al.  3-D Motion Estimation Using Range Data , 2007, IEEE Transactions on Intelligent Transportation Systems.

[7]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[8]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[9]  Hagen Spies.  Analysing dynamic processes in range data sequences , 2001 .

[10]  Alonzo Kelly,et al.  Experimental Characterization of Commercial Flash Ladar Devices , 2005 .

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.