Unbounded High Dynamic Range Photography Using a Modulo Camera

This paper presents a novel framework to extend the dynamic range of images called Unbounded High Dynamic Range (UHDR) photography with a modulo camera. A modulo camera could theoretically take unbounded radiance levels by keeping only the least significant bits. We show that with limited bit depth, very high radiance levels can be recovered from a single modulus image with our newly proposed unwrapping algorithm for natural images. We can also obtain an HDR image with details equally well preserved for all radiance levels by merging the least number of modulus images. Synthetic experiment and experiment with a real modulo camera show the effectiveness of the proposed approach.

[1]  Manuel Servin,et al.  2D simultaneous phase unwrapping and filtering: A review and comparison , 2012 .

[2]  R. Hamilton Shepard,et al.  Simultaneous Dynamic Pupil Coding with On-chip Coded Aperture Temporal Imaging , 2014 .

[3]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[4]  Rudiger Gens,et al.  Two-dimensional phase unwrapping for radar interferometry: Developments and new challenges , 2003 .

[5]  M. Fiddy,et al.  Signal recovery and synthesis , 1998 .

[6]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Brian Tyrrell,et al.  Digital-pixel focal plane array development , 2010, OPTO.

[8]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Shree K. Nayar,et al.  Fibonacci Exposure Bracketing for High Dynamic Range Imaging , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  José M. Bioucas-Dias,et al.  Phase Unwrapping via Graph Cuts , 2005, IEEE Transactions on Image Processing.

[11]  Petra Kaufmann,et al.  Two Dimensional Phase Unwrapping Theory Algorithms And Software , 2016 .

[12]  S. Chavez,et al.  Understanding phase maps in MRI: a new cutline phase unwrapping method , 2002, IEEE Transactions on Medical Imaging.

[13]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Keigo Hirakawa,et al.  Single-shot high dynamic range imaging with conventional camera hardware , 2011, 2011 International Conference on Computer Vision.

[15]  Ramesh Raskar,et al.  Coded time of flight cameras , 2013, ACM Trans. Graph..

[16]  David J Field,et al.  Statistical regularities of art images and natural scenes: spectra, sparseness and nonlinearities. , 2007, Spatial vision.

[17]  MOHIT GUPTA,et al.  Phasor Imaging , 2015, ACM Trans. Graph..

[18]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[20]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[21]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[23]  Shree K. Nayar,et al.  High Dynamic Range from Multiple Images: Which Exposures to Combine?∗ , 2003 .

[24]  Shree K. Nayar,et al.  Adaptive dynamic range imaging: optical control of pixel exposures over space and time , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  B. Tyrrell,et al.  Time Delay Integration and In-Pixel Spatiotemporal Filtering Using a Nanoscale Digital CMOS Focal Plane Readout , 2009, IEEE Transactions on Electron Devices.

[26]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).