Efficient Estimation of Multiple Illuminant Directions Using C-means Clustering and Self-correction for Augmented Reality

This paper presents a novel method to estimate multiple illuminant directions from a single image in augmented reality system. A square marker is used for 2D-3D registration, and a mirror sphere with known size is employed to detect light sources. Highlight pixels in captured sphere image are analyzed by using c-means clustering algorithm and its initialization with max-min distance method. The initialization estimates number of light sources and initial highlight areas centroids. c-means algorithm optimizes each position of the centroids. With the help of registration, multiple illuminant directions are calculated from the centroids and user’s viewpoint. Moreover, a self-correction course reduces estimation errors. Experimental results show that our approach is computationally efficient and multiple illuminant directions can be accurately obtained by it.

[1]  Paul Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[2]  T. Luckeneder,et al.  "Shadow Catcher": a vision based illumination condition sensor using ARToolKit , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[3]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  佐藤 宏介,et al.  A LCD cube transporting high dynamic range light environments , 2003 .

[5]  Atsuto Maki,et al.  Difference Sphere: An Approach to Near Light Source Estimation , 2004, CVPR.

[6]  Wei Zhou,et al.  Estimation of Illuminant Direction and Intensity of Multiple Light Sources , 2002, ECCV.

[7]  Li Li,et al.  Photorealistic rendering for augmented reality using environment illumination , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[8]  Mike Brookes,et al.  Multiple light source detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Naokazu Yokoya,et al.  Real-time estimation of light source environment for photorealistic augmented reality , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Alan L. Yuille,et al.  Sources from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Yang Wang,et al.  Estimation of multiple directional light sources for synthesis of mixed reality images , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[12]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .