Programmable Aperture Camera Using LCoS

Since 1960s, aperture patterns have been studied extensively and a variety of coded apertures have been proposed for various applications, including extended depth of field, defocus deblurring, depth from defocus, light field acquisition, etc. Researches have shown that optimal aperture patterns can be quite different due to different applications, imaging conditions, or scene contents. In addition, many coded aperture techniques require aperture patterns to be temporally changed during capturing. As a result, it is often necessary to have a programmable aperture camera whose aperture pattern can be dynamically changed as needed in order to capture more useful information. In this paper, we propose a programmable aperture camera using a Liquid Crystal on Silicon (LCoS) device. This design affords a high brightness contrast and high resolution aperture with a relatively low light loss, and enables one change the pattern at a reasonably high frame rate. We build a prototype camera and evaluate its features and drawbacks comprehensively by experiments. We also demonstrate three coded aperture applications in defocus deblurring, depth from defocus and light field acquisition.

[1]  W. Welford Use of Annular Apertures to Increase Focal Depth , 1960 .

[2]  M. Mino,et al.  Improvement in the OTF of a Defocused Optical System Through the Use of Shaded Apertures. , 1971, Applied optics.

[3]  Chanin Varamit,et al.  Imaging properties of defocused partitioned pupils , 1985 .

[4]  J. Ojeda-Castañeda,et al.  Annular apodizers for low sensitivity to defocus and to spherical aberration. , 1986, Optics letters.

[5]  E. Caroli,et al.  Coded aperture imaging in X- and gamma-ray astronomy , 1987 .

[6]  E E Fenimore,et al.  New family of binary arrays for coded aperture imaging. , 1989, Applied optics.

[7]  W. Cathey,et al.  Extended depth of field through wave-front coding. , 1995, Applied optics.

[8]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[9]  Shree K. Nayar,et al.  A theory of multiplexed illumination , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[11]  Shree K. Nayar,et al.  Programmable Imaging: Towards a Flexible Camera , 2006, International Journal of Computer Vision.

[12]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[13]  Shree K. Nayar,et al.  Lensless Imaging with a Controllable Aperture , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Frédo Durand,et al.  Multi-aperture photography , 2007, SIGGRAPH 2007.

[15]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[16]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[17]  Yasushi Yagi,et al.  High Dynamic Range Camera using Reflective Liquid Crystal , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Tomoyuki Nishita,et al.  Extracting depth and matte using a color-filtered aperture , 2008, SIGGRAPH 2008.

[19]  Shree K. Nayar,et al.  Flexible Depth of Field Photography , 2008, ECCV.

[20]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[21]  Stephen Lin,et al.  Coded aperture pairs for depth from defocus , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Kiriakos N. Kutulakos,et al.  Time-constrained photography , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[24]  Shree K. Nayar,et al.  Programmable Aperture Camera Using LCoS , 2010, IPSJ Trans. Comput. Vis. Appl..