Gigapixel Computational Imaging

Today, consumer cameras produce photographs with tens of millions of pixels. The recent trend in image sensor resolution seems to suggest that we will soon have cameras with billions of pixels. However, the resolution of any camera is fundamentally limited by geometric aberrations. We derive a scaling law that shows that, by using computations to correct for aberrations, we can create cameras with unprecedented resolution that have low lens complexity and compact form factor. In this paper, we present an architecture for gigapixel imaging that is compact and utilizes a simple optical design. The architecture consists of a ball lens shared by several small planar sensors, and a post-capture image processing stage. Several variants of this architecture are shown for capturing a contiguous hemispherical field of view as well as a complete spherical field of view. We demonstrate the effectiveness of our architecture by showing example images captured with two proof-of-concept gigapixel cameras.

[1]  David G. Stork,et al.  Extending depth-of-field: Spherical coding versus asymmetric wavefront coding , 2009 .

[2]  Vikrant R. Bhakta,et al.  Experimental validation of extended depth-of-field imaging via spherical coding , 2009 .

[3]  P. Peumans,et al.  Curving monolithic silicon for nonplanar focal plane array applications , 2008 .

[4]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[5]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[6]  J. Goodman.  Introduction to Fourier optics , 1969 .

[7]  David G. Stork,et al.  Spherical coded imagers: improving lens speed, depth-of-field, and manufacturing yield through enhanced spherical aberration and compensating image processing , 2009, Optical Engineering + Applications.

[8]  Shree K. Nayar,et al.  Towards a true spherical camera , 2009, Electronic Imaging.

[9]  Moshe Ben-Ezra,et al.  High resolution large format tile-scan camera: Design, calibration, and extended depth of field , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[10]  P. Peumans,et al.  The optical advantages of curved focal plane arrays. , 2008, Optics express.

[11]  Ulrich Amsel,et al.  The History of the Photographic Lens , 1922, Nature.

[12]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[13]  Heung Cho Ko,et al.  A hemispherical electronic eye camera based on compressible silicon optoelectronics , 2008, Nature.

[14]  Luke P. Lee,et al.  Inspirations from Biological Optics for Advanced Photonic Systems , 2005, Science.

[15]  Wolfgang Heidrich,et al.  The Design of an Inexpensive Very High Resolution Scan Camera System , 2004, Comput. Graph. Forum.

[16]  R. K. Luneburg,et al.  Mathematical Theory of Optics , 1966 .

[17]  Frédéric Guichard,et al.  Extended depth-of-field using sharpness transport across color channels , 2009, Electronic Imaging.

[18]  Oliver Cossairt,et al.  Spectral Focal Sweep: Extended depth of field from chromatic aberrations , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[19]  Robert H. Cormack,et al.  Wavefront coding: jointly optimized optical and digital imaging systems , 2000, SPIE Defense + Commercial Sensing.

[20]  Nathan Hagen,et al.  Multiscale lens design. , 2009, Optics express.

[21]  H.-S. Philip Wong,et al.  A 3MPixel Multi-Aperture Image Sensor with 0.7μm Pixels in 0.11μm CMOS , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[22]  W. Cathey,et al.  Extended depth of field through wave-front coding. , 1995, Applied optics.

[23]  David J. Brady,et al.  Gigagon: a Monocentric Lens Design Imaging 40 Gigapixels , 2010 .

[24]  A W Lohmann,et al.  Scaling laws for lens systems. , 1989, Applied optics.

[25]  Shree K. Nayar,et al.  Scene Collages and Flexible Camera Arrays , 2007, Rendering Techniques.