Panorama creation using a team of robots

A system is presented which allows a single human to teleoperate a team of camera-equipped robots. This paper emphasizes the image processing required to take a number of views and construct a single panorama which provides a sense of a 3-D environment to the operator who finds it easy to comprehend the environment and to control the team using something as simple as a joystick. Since the cameras have diverse poses, their output images must be distorted to provide smooth alignment. This is accomplished by correspondence finding, triangular tessellation and warping of a portion of each view. The panorama which gives a 180° field-of-view is projected onto a semi-circular array of monitors to provide the operator with a sensation of both forward and peripheral views.

[1]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Robin Hess.  An Open-Source SIFT Library , 2010 .

[5]  Griff Bilbro,et al.  Teleoperation of a Team of Robots with Vision , 2010 .

[6]  George Wolberg,et al.  Digital image warping , 1990 .

[7]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[8]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[9]  Rob Hess,et al.  An open-source SIFTLibrary , 2010, ACM Multimedia.

[10]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[11]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[12]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[13]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[17]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[19]  David L. Milgram,et al.  Computer Methods for Creating Photomosaics , 1975, IEEE Transactions on Computers.