Fast Separation of Specular, Diffuse, and Global Components via Polarized Pattern Projection

In this paper, we propose a method for fast separation of specular, diffuse, and global components of a dynamic scene by using a projector-camera system. Both the direct-global separation using spatially high-frequency patterns and the specular-diffuse separation based on polarization have been studied, but a straightforward combination of those methods has limited temporal resolution. Accordingly, our proposed method rapidly changes not only the spatial patterns but also the polarization states of illumination by using a self-build polarization projector, and captures their effects on a scene by using a highspeed camera. Our method is easy-to-implement, because it does not require projector-camera temporal synchronization and it automatically calibrates the correspondence between the projection pattern and camera pixel. In addition, our method is robust due to the optimized and quickly-shifted projection pattern and the weights for incorporating spatial correlation. We implemented the prototype setup and achieved fast separation with 60 fps.