Measuring and modelling sewer pipes from video

This article presents a system for the automatic measurement and modelling of sewer pipes. The system recovers the interior shape of a sewer pipe from a video sequence which is acquired by a fish-eye lens camera moving inside the pipe. The approach is based on tracking interest points across successive video frames and posing the general structure-from-motion problem. It is shown that the tracked points can be reliably reconstructed despite the forward motion of the camera. This is achieved by utilizing a fish-eye lens with a wide field of view. The standard techniques for robust estimation of the two- and three-view geometry are modified so that they can be used for calibrated fish-eye lens cameras with a field of view less than 180°. The tubular arrangement of the reconstructed points allows pipe shape estimation by surface fitting. Hence, a method for modelling such surfaces with a locally cylindrical model is proposed. The system is demonstrated with a real sewer video and an error analysis for the recovered structure is presented.

[1]  Helge-Björn Kuntze,et al.  Experiences with the development of a robot for smart multisensoric pipe inspection , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[2]  Maxime Lhuillier,et al.  Automatic scene structure and camera motion using a catadioptric system , 2008, Comput. Vis. Image Underst..

[3]  Mathieu Perriollat,et al.  Uncertainty ellipsoids calculations for complex 3D reconstructions , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[4]  Heinrich Niemann,et al.  Nonlinear Refinement of Camera Parameters Using an Endoscopic Surgery Robot , 2002, MVA.

[5]  Olivier D. Faugeras,et al.  Characterizing the Uncertainty of the Fundamental Matrix , 1997, Comput. Vis. Image Underst..

[6]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[7]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Paul W. Fieguth,et al.  Morphological segmentation and classification of underground pipe images , 2006, Machine Vision and Applications.

[9]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  T. Davies,et al.  Sewer pipe deformation assessment by image analysis of video surveys , 1998, Pattern Recognit..

[11]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[12]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ralph R. Martin,et al.  Faithful Least-Squares Fitting of Spheres, Cylinders, Cones and Tori for Reliable Segmentation , 1998, ECCV.

[14]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[16]  Sami S. Brandt.  On the Probabilistic Epipolar Geometry , 2004, BMVC.

[17]  Tony P. Pridmore,et al.  Towards the recovery of extrinsic camera parameters from video records of sewer surveys , 1998, Machine Vision and Applications.

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  Darius Burschka,et al.  Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery , 2004, MICCAI.

[20]  Juho Kannala,et al.  Measuring the Shape of Sewer Pipes from Video , 2005, MVA.

[21]  Tim Ellis,et al.  A semi-autonomous sewer surveillance and inspection vehicle , 1996, Proceedings of Conference on Intelligent Vehicles.

[22]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[23]  Maxime Lhuillier,et al.  Automatic Structure and Motion using a Catadioptric Camera , 2005 .

[24]  Robert B. Fisher,et al.  Modelling Objects having Quadric Surfaces Incorporating Geometric cCnstraints , 1998, ECCV.

[25]  Andrew W. Fitzgibbon,et al.  Automatic 3D model acquisition and generation of new images from video sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[26]  Kostas Daniilidis,et al.  Structure and motion from uncalibrated catadioptric views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Dulcy M. Abraham,et al.  NEURO-FUZZY APPROACHES FOR SANITARY SEWER PIPELINE CONDITION ASSESSMENT , 2001 .

[29]  Petko Faber,et al.  A Buyer's Guide to Euclidean Elliptical Cylindrical and Conical Surface Fitting , 2001, BMVC.

[30]  Hans-Jürgen Warnecke,et al.  Orthogonal Distance Fitting of Implicit Curves and Surfaces , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[33]  Josef Jansa,et al.  Advanced methods and applications , 1997 .