D Image Acquisition and Processing with high continuous Data Throughput for Human-Machine-Interaction and Adaptive Manufacturing 1

Many applications in industrial environment are able to detect structures in measurement volumes from macroscopic to microscopic range. One way to process the resulting image data and to calculate three-dimensional (3D) images is the use of active stereo vision technology. In this context, one of the main challenges is to deal with the permanently increasing amount of data. This paper aims to describes methods for handling the required data throughput for 3D image acquisition in active stereo vision systems. Thus, the main focus is on implementing the steps of the image processing chain on re-configurable hardware. Among other things, this includes the pre-processing step with the correction of distortion and rectification of incoming image data. Therefore, the approach uses the offline pre-calculation of rectification maps. Furthermore, with the aid of the rectified maps, each image is directly rectified during the image acquisition. Afterwards, an FPGA and GPU-based approach is selected for optimal performance of stereo matching and 3D point calculation. Index Terms – three-dimensional measurement, high-speed projection, re-configurable hardware

[1]  Oliver Schreer Stereoanalyse und Bildsynthese , 2007 .

[2]  Peter Kühmstedt,et al.  Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement , 2014 .

[3]  Peter Kühmstedt,et al.  Phase-shifting fringe projection system using freeform optics , 2011, Optical Systems Design.

[4]  G. Frankowski,et al.  DLP-based 3D metrology by structured light or projected fringe technology for life sciences and industrial metrology , 2009, MOEMS-MEMS.

[5]  John Morris,et al.  Comparison of FPGA and GPU implementations of real-time stereo vision , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[6]  Song Zhang,et al.  Toward superfast three-dimensional optical metrology with digital micromirror device platforms , 2014 .

[7]  Peter Ott Imaging with tilted surfaces: an efficient matrix method for the generalized Scheimpflug condition and its application to rotationally symmetric triangulation. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  A. Tünnermann,et al.  High-speed three-dimensional shape measurement using GOBO projection , 2016 .

[9]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .

[10]  Lars Asplund,et al.  GIMME2 - an embedded system for stereo vision and processing of megapixel images with FPGA-acceleration , 2015, 2015 International Conference on ReConFigurable Computing and FPGAs (ReConFig).

[11]  Mark L. Chang,et al.  Low-Cost Stereo Vision on an FPGA , 2007 .

[12]  Tian-Sheuan Chang,et al.  Real-Time DSP Implementation on Local Stereo Matching , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[13]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[14]  Andreas Tünnermann,et al.  Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement. , 2015, Applied optics.

[15]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[16]  Stefano Mattoccia,et al.  A passive RGBD sensor for accurate and real-time depth sensing self-contained into an FPGA , 2015, ICDSC.

[17]  Markus H. Gross,et al.  An FPGA-based processing pipeline for high-definition stereo video , 2011, EURASIP J. Image Video Process..