Computational lighting reproduction for facial live video with rigid facial motion

In the field of virtual studios in the television industry, the facial live video stream and background scenes must be composed in real time. One of the complex problems in this compositing is matching the lighting between the facial live video and the background scene. In this paper, we develop a practical lighting reproduction technique to reproduce the appearance of a face in the facial live video with rigid facial motion in real time under an arbitrary environmental lighting condition.