A New Illumination Compensation Method based on Color Optimization Function for Generating 3D Volumetric Model

In this paper, we propose a color correction technique for images acquired through a multi-view camera system for acquiring a 3D model. It is assumed that the 3D volume is captured indoors, and the position and intensity of the light is constant over time. 8 multi-view cameras are used, and converging toward the center of the space, so even if the lighting is constant, the intensity and angle of light entering each camera may be different. Therefore, a color optimization function is applied to a color correction chart taken from all cameras, and a color conversion matrix defining a relationship between the obtained 8 images is calculated. Using this, the images of all cameras are corrected based on the standard color correction chart. This paper proposed a color correction method to minimize the color difference between cameras when acquiring an image using 8 cameras of 3D objects, and experimentally proved that the color difference between images is reduced when it is restored to a 3D image. Keyword : illumination compensation, 3D volumetric model, calibration, color optimization function Copyright C 2020 Korean Institute of Broadcast and Media Engineers. All rights reserved. “This is an Open-Access article distributed under the terms of the Creative Commons BY-NC-ND (http://creativecommons.org/licenses/by-nc-nd/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited and not altered.” 일반논문 (Regular Paper) 방송공학회논문지 제25권 제4호, 2020년 7월 (JBE Vol. 25, No. 4, July 2020) https://doi.org/10.5909/JBE.2020.25.4.598 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) 박병서 외 3인: 3차원 체적 모델의 생성을 위한 색상 최적화 함수 기반의 조명 보상 기법 599 (Byung-Seo Park et al.: A New Illumination Compensation Method based on Color Optimization Function for Generating 3D Volumetric Model)

[1]  Rajeev Srivastava,et al.  Automatic moving object segmentation methods under varying illumination conditions for video data: comparative study, and an improved method , 2016, Multimedia Tools and Applications.

[2]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[3]  Shanq-Jang Ruan,et al.  Improved local histogram equalization with gradient-based weighting process for edge preservation , 2015, Multimedia Tools and Applications.

[4]  Carlo Gatta,et al.  A new algorithm for unsupervised global and local color correction , 2003, Pattern Recognit. Lett..

[5]  Antonios Gasteratos,et al.  Fast centre- surround contrast modification , 2008 .

[6]  Xuelong Li,et al.  Intrinsic images using optimization , 2011, CVPR 2011.

[7]  Hung-Son Le,et al.  Fused logarithmic transform for contrast enhancement , 2008 .

[8]  Wei Liu,et al.  Real-time 3D human capture system for mixed-reality art and entertainment , 2005, IEEE Transactions on Visualization and Computer Graphics.

[9]  Nai-Chung Yang,et al.  An effective and flexible image enhancement algorithm in compressed domain , 2014, Multimedia Tools and Applications.

[10]  Carlo Gatta,et al.  A Spatially Variant White-Patch and Gray-World Method for Color Image Enhancement Driven by Local Contrast , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[12]  Zhisheng Zhang,et al.  An efficient estimation method for intensity factor of illumination changes , 2013, Multimedia Tools and Applications.

[13]  Dong Ye,et al.  An illumination-independent edge detection and fuzzy enhancement algorithm based on wavelet transform for non-uniform weak illumination images , 2008, Pattern Recognit. Lett..

[14]  Shiv Ram Dubey,et al.  A multi-channel based illumination compensation mechanism for brightness invariant image retrieval , 2015, Multimedia Tools and Applications.

[15]  Peter Kauff,et al.  Interactive Steaming of Panoramas and VR Worlds , 2017 .

[16]  Zhihui Wang,et al.  Illumination-based nighttime video contrast enhancement using genetic algorithm , 2012, Multimedia Tools and Applications.

[17]  Nor Ashidi Mat Isa,et al.  Enhancer-based contrast enhancement technique for non-uniform illumination and low-contrast images , 2017, Multimedia Tools and Applications.

[18]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time dynamic 3D surface reconstruction and interaction , 2011, SIGGRAPH '11.

[19]  Zongqian Zhan,et al.  A Method of Hierarchical Image Retrieval for Real-Time Photogrammetry Based on Multiple Features , 2020, IEEE Access.

[20]  Soon-Yong Park,et al.  Convenient View Calibration of Multiple RGB-D Cameras Using a Spherical Object , 2014 .