Time budget evaluation for image-based reconstruction of sewer shafts

In this paper we propose a robust real-time image and sensor based approach for automatic 3d model acquisition of sewer shafts from survey videos captured by a downward-looking fisheye-lens camera while lowering it into the shaft. Our approach is based on Structure from Motion adjusted to the constrained motion and scene, and involves shape recognition techniques in order to obtain the geometry of the scene appropriately. We perform a time budget evaluation for the components of an existing off-line application based on previous work and design a real-time application which can be applied during on-site inspection. The methods of our approach are modified so that they can be executed on the GPU. Expensive bundle adjustment is avoided by applying a simple and fast geometric correction of the computed reconstruction which is capable of handling inaccuracies of the intrinsic camera calibration parameters.

[1]  Jan-Michael Frahm,et al.  Fast gain-adaptive KLT tracking on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[2]  William R. Mark,et al.  Cg: a system for programming graphics hardware in a C-like language , 2003, ACM Trans. Graph..

[3]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[4]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[5]  David Nistér,et al.  Preemptive RANSAC for live structure and motion estimation , 2005, Machine Vision and Applications.

[6]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[7]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Nello Cristianini,et al.  Handbook of Geometric Computing : Applications in Pattern Recognition , 2005 .

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Reinhard Koch,et al.  Reconstruction of Sewer Shaft Profiles from Fisheye-Lens Camera Images , 2009, DAGM-Symposium.

[11]  Michael Felsberg,et al.  Fast and Accurate Structure and Motion Estimation , 2009, ISVC.

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Juho Kannala,et al.  Measuring and modelling sewer pipes from video , 2007, Machine Vision and Applications.

[14]  Michel Dhome,et al.  Generic and Real-Time Structure from Motion , 2007, BMVC.

[15]  Yakup Genc,et al.  GPU-based Video Feature Tracking And Matching , 2006 .

[16]  Ruigang Yang,et al.  Gain Adaptive Real-Time Stereo Streaming , 2007 .

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Tony P. Pridmore,et al.  Towards the recovery of extrinsic camera parameters from video records of sewer surveys , 1998, Machine Vision and Applications.

[19]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[20]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Juho Kannala,et al.  Measuring the Shape of Sewer Pipes from Video , 2005, MVA.