Super-resolution reconstruction in a computational compound-eye imaging system

From consumer electronics to biomedical applications, device miniaturization has shown to be highly desirable. This often includes reducing the size of some optical systems. However, diffraction effects impose a constraint on image quality when we simply scale down the imaging parameters. Over the past few years, compound-eye imaging system has emerged as a promising architecture in the development of compact visual systems. Because multiple low-resolution (LR) sub-images are captured, post-processing algorithms for the reconstruction of a high-resolution (HR) final image from the LR images play a critical role in affecting the image quality. In this paper, we describe and investigate the performance of a compound-eye system recently reported in the literature. We discuss both the physical construction and the mathematical model of the imaging components, followed by an application of our super-resolution algorithm in reconstructing the image. We then explore several variations of the imaging system, such as the incorporation of a phase mask in extending the depth of field, which are not possible with a traditional camera. Simulations with a versatile virtual camera system that we have built verify the feasibility of these additions, and we also report the tolerance of the compound-eye system to variations in physical parameters, such as optical aberrations, that are inevitable in actual systems.

[1]  Joseph van der Gracht,et al.  Evolutionary paths in imaging and recent trends. , 2003, Optics express.

[2]  Jun Tanida,et al.  Reconstruction of a high-resolution image on a compound-eye image-capturing system. , 2004, Applied optics.

[3]  Yiannis Aloimonos,et al.  Compound eye sensor for 3D ego motion estimation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[4]  Nirmal K. Bose,et al.  High‐resolution image reconstruction with multisensors , 1998, Int. J. Imaging Syst. Technol..

[5]  E. Shen,et al.  High precision target tracking with a compound-eye image sensor , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[6]  Michael K. Ng,et al.  A Fast MAP Algorithm for High-Resolution Image Reconstruction with Multisensors , 2001, Multidimens. Syst. Signal Process..

[7]  M. Ng,et al.  Cosine transform preconditioners for high resolution image reconstruction , 2000 .

[8]  M. Ng,et al.  Analysis of displacement errors in high-resolution image reconstruction with multisensors , 2002 .

[9]  J. Goodman Introduction to Fourier optics , 1969 .

[10]  Sudhakar Prasad,et al.  High‐resolution imaging using integrated optical systems , 2004, Int. J. Imaging Syst. Technol..

[11]  W. Cathey,et al.  Phase plate to extend the depth of field of incoherent hybrid imaging systems. , 2004, Applied optics.

[12]  J W Goodman,et al.  Discrete cosine transform domain restoration of defocused images. , 1998, Applied optics.

[13]  Jorge Ojeda-Castañeda,et al.  Asymmetric phase masks for extended depth of field. , 2004, Applied optics.

[14]  J. Tanida,et al.  Thin Observation Module by Bound Optics (TOMBO): Concept and Experimental Verification. , 2001, Applied optics.

[15]  Nirmal K. Bose,et al.  Mathematical analysis of super-resolution methodology , 2003, IEEE Signal Process. Mag..

[16]  W T Cathey,et al.  Single-lens single-image incoherent passive-ranging systems. , 1994, Applied optics.

[17]  Edmund Y Lam Digital restoration of defocused images in the wavelet domain. , 2002, Applied optics.

[18]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[19]  Peter Schreiber,et al.  Artificial compound eyes: different concepts and their application for ultraflat image acquisition sensors , 2004, SPIE MOEMS-MEMS.

[20]  Richard Hornsey,et al.  Electronic compound-eye image sensor: construction and calibration , 2004, IS&T/SPIE Electronic Imaging.

[21]  A. Tünnermann,et al.  Thin compound-eye camera. , 2005, Applied optics.

[22]  Andreas Tünnermann,et al.  Microoptical telescope compound eye. , 2005, Optics express.

[23]  W. Cathey,et al.  Extended depth of field through wave-front coding. , 1995, Applied optics.