Automatic selection of color reference image for panoramic stitching

Color correction is an important step in the generation of high-resolution stitched panoramas. Typically, color correction schemes try to match the color of each image in the panorama to an arbitrarily selected reference image. We provide a scheme that uses quantitative metrics such as image contrast, gradient-based structure similarity index measure (G-SSIM) and color clipping information to automatically select the best reference that results in visually pleasing output panoramas. Quantitative and qualitative evaluation of the scheme show encouraging results for panoramic images as well as for stitched videos. The scheme acts as a pre-processing step to color correction and its applicability to both parametric and non-parametric global color correction schemes has also been demonstrated.

[1]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[2]  Colin Doutre,et al.  Fast vignetting correction and color matching for panoramic image stitching , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Michael F. Cohen,et al.  Video enhanced gigapixel panoramas , 2012, SIGGRAPH 2012.

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Peter Eisert,et al.  Creation of High-Resolution Video Panoramas of Sport Events , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[6]  Don Kimber,et al.  FlyAbout: spatially indexed panoramic video , 2001, MULTIMEDIA '01.

[7]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[8]  Yingen Xiong,et al.  Fast image stitching and editing for panorama painting on mobile phones , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[9]  Yingen Xiong,et al.  Fast panorama stitching for high-quality panoramic images on mobile phones , 2010, IEEE Transactions on Consumer Electronics.

[10]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[11]  W. Brent Seales,et al.  Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery , 1999, MULTIMEDIA '99.

[12]  Gui Yun Tian,et al.  Colour correction for panoramic imaging , 2002, Proceedings Sixth International Conference on Information Visualisation.

[13]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[14]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Illah Nourbakhsh,et al.  Timelapse GigaPan: Capturing, Sharing, and Exploring Timelapse Gigapixel Imagery , 2010 .

[16]  Chi-Keung Tang,et al.  Image registration with global and local luminance alignment , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Christian Weissig,et al.  Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production , 2013, Proceedings of the IEEE.

[18]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Yingen Xiong,et al.  Fast and High-Quality Image Blending on Mobile Phones , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.

[21]  Yiwen Sun,et al.  Scalable Resolution Display Walls , 2013, Proceedings of the IEEE.

[22]  Hong Li,et al.  Selective color transfer with multi-source images , 2009, Pattern Recognit. Lett..

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Muhammad Twaha Ibrahim,et al.  Automatic Reference Selection for Parametric Color Correction Schemes for Panoramic Video Stitching , 2012, ISVC.

[25]  Gui Yun Tian,et al.  Panoramic imaging - a review , 2003, Comput. Graph..

[26]  K. Frenkel.  Panning for science. , 2010, Science.

[27]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[28]  Naokazu Yokoya,et al.  High-resolution panoramic movie generation from video streams acquired by an omnidirectional multi-camera system , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[29]  Yingen Xiong,et al.  Color matching for high-quality panoramic images on mobile phones , 2010, IEEE Transactions on Consumer Electronics.

[30]  Sebastian Möller,et al.  Towards a new ITU-T recommendation for subjective methods evaluating gaming QoE , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).