Recovering badly exposed objects from digital photos using internet images

In this paper we consider the problem of clipped-pixel recovery over an entire badly exposed image region, using two correctly exposed images of the scene that may be captured under different conditions. The first reference image is used to recover texture; feature points are extracted along the boundaries of both the source and reference regions, while a warping function deforms the reference region to fit inside the source. The second reference is used to recover color by replacing the mean and variance of the texture reference image with those of the color reference. A user study conducted with both modified and original images demonstrates the benefits of our method. The results show that a majority of the enhanced images look natural and are preferred to the originals.

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  Richard Szeliski,et al.  The Moment Camera , 2006, Computer.

[3]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[4]  Edward H. Adelson,et al.  Personal photo enhancement using example images , 2010, TOGS.

[5]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[6]  Hans-Peter Seidel,et al.  Enhancement of Bright Video Features for HDR Displays , 2008 .

[7]  Sylvain Paris,et al.  Learning photographic global tonal adjustment with a database of input / output image pairs , 2011, CVPR 2011.

[8]  Andrew Zisserman,et al.  Get Out of my Picture! Internet-based Inpainting , 2009, BMVC.

[9]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[11]  Yuan Cheng,et al.  Correcting over-exposure in photographs , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Jan-Michael Frahm,et al.  Personal Photograph Enhancement Using Internet Photo Collections , 2014, IEEE Transactions on Visualization and Computer Graphics.

[13]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[14]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jiejie Zhu,et al.  Automatic Correction of Saturated Regions in Photographs using Cross‐Channel Correlation , 2009, Comput. Graph. Forum.

[16]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[18]  Steven M. Seitz,et al.  The dimensionality of scene appearance , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2008, Commun. ACM.

[20]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..

[21]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Stephen Lin,et al.  Intrinsic colorization , 2008, SIGGRAPH 2008.

[23]  Xuemei Zhang,et al.  Estimation of saturated pixel values in digital color imaging. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.