Big snapshot stitching with scarce overlap

We address certain properties that arise in gigapixel-scale image stitching for snapshot images captured with a novel micro-camera array system, AWARE-2. This system features a greatly extended field of view and high optical resolution, offering unique sensing capabilities for a host of important applications. However, three simultaneously arising conditions pose a challenge to existing approaches to image stitching, with regard to the quality of the output image as well as the automation and efficiency of the image composition process. Put simply, they may be described as the sparse, geometrically irregular, and noisy (S.I.N.) overlap amongst the fields of view of the constituent micro-cameras. We introduce a computational pipeline for image stitching under these conditions, which is scalable in terms of complexity and efficiency. With it, we also substantially reduce or eliminate ghosting effects due to misalignment factors, without entailing manual intervention. Our present implementation of the pipeline leverages the combined use of multicore and GPU architectures. We present experimental results with the pipeline on real image data acquired with AWARE-2.

[1]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[2]  Pierre Soille,et al.  An interactive image mining tool handling gigapixel images , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[3]  A. Pathare,et al.  Field measurements of horizontal forward motion velocities of terrestrial dust devils: Towards a proxy for ambient winds on Mars and Earth , 2012 .

[4]  D R Golish,et al.  Development of a scalable image formation pipeline for multiscale gigapixel photography. , 2012, Optics express.

[5]  Moshe Ben-Ezra,et al.  A Digital Gigapixel Large-Format Tile-Scan Camera , 2011, IEEE Computer Graphics and Applications.

[6]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[7]  Jennifer A. Scott,et al.  Algorithm 891: A Fortran virtual memory system , 2009, TOMS.

[8]  David J. Brady,et al.  Close-up imaging using microcamera arrays for focal plane synthesis , 2011 .

[9]  Peyman Milanfar,et al.  Fast Local and Global Projection-Based Methods for Affine Motion Estimation , 2004, Journal of Mathematical Imaging and Vision.

[10]  Christian Breiteneder,et al.  Detection and Classification of Petroglyphs in Gigapixel Images - Preliminary Results , 2011, VAST.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  A. McEwen,et al.  Mars Reconnaissance Orbiter's High Resolution Imaging Science Experiment (HiRISE) , 2007 .

[13]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Subu Surendran,et al.  SATELLITE IMAGE REGISTRATION AND IMAGE STITCHING , 2013 .

[16]  Michael F. Cohen,et al.  Capturing and viewing gigapixel images , 2007, ACM Trans. Graph..

[17]  Zeev Farbman,et al.  Convolution pyramids , 2011, ACM Trans. Graph..

[18]  Richard Szeliski,et al.  Seamless Image Stitching of Scenes with Large Motions and Exposure Differences , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[20]  Mary H. Nichols,et al.  Very-High-Resolution Panoramic Photography to Improve Conventional Rangeland Monitoring , 2009 .

[21]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[22]  Daniel L Marks,et al.  Design and scaling of monocentric multiscale imagers. , 2012, Applied optics.

[23]  John A. Antoniades,et al.  Autonomous real-time ground ubiquitous surveillance-imaging system (ARGUS-IS) , 2008, SPIE Defense + Commercial Sensing.

[24]  Richard Szeliski,et al.  Pushing the Envelope of Modern Methods for Bundle Adjustment , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[28]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[29]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[30]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[31]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[32]  Keiichiro Kagawa,et al.  A thin and compact compound-eye imaging system incorporated with an image restoration considering color shift, brightness variation, and defocus , 2009 .

[33]  David J. Brady,et al.  Multiscale gigapixel photography , 2012, Nature.