Panoramic optical-servoing for industrial inspection and repair

Recently specialized robots were introduced to perform the task of inspection and repair in large cylindrical structures such as ladles, melting furnaces and converters. This paper reports on the image processing system and optical servoing for one such a robot. A panoramic image of the vessels inner surface is produced by performing a coordinated robot motion and image acquisition. The level of projective distortion is minimized by acquiring a high density of images. Normalized phase correlation calculated via the 2D Fourier transform is used to calculate the shift between the single images. The narrow strips from the dense image map are then stitched together to build the panorama. The mapping between the panoramic image and the positioning of the robot is established during the stitching of the images. This enables optical feedback. The robots operator can locate a defect on the surface by selecting the area of the image. Calculation of the forward and inverse kinematics enable the robot to automatically move to the location on the surface requiring repair. Experimental results using a standard 6R industrial robot have shown the full functionality of the system concept. Finally, were test measurements carried out successfully, in a ladle at a temperature of 1100° C.