Interactive Poisson photometric propagation for facial composite

In image composition, the inconsistent illumination of the source images is one of the major problems for seamless stitching of separated patches. The Poisson image editing is a sound technique for seamless image composition. In this paper, we have generalized and improved this technique and applied it onto solving the illumination discontinuity problem for facial image composition. Toward stitched image with patches of arbitrary shapes and number, an extended Poisson equation is proposed. To solve this equation efficiently, a layer-based Poisson solution propagation algorithm is designed. Based on above, an interactive photometric alignment system for facial compositing image is built. In the experiments, the photometric propagation effects with respect to user's selections are compared. Its time performance is also investigated. The experimental results verified the effectiveness and efficiency of the proposed method.

[1]  Charlie D. Frowd,et al.  Adding holistic dimensions to a facial composite system , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[2]  Chi-Keung Tang,et al.  Eliminating structure and intensity misalignment in image stitching , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[4]  Song-Chun Zhu,et al.  A Multi-Resolution Dynamic Model for Face Aging Simulation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[6]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[7]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[8]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[9]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[10]  Jonathan Richard Shewchuk,et al.  Delaunay refinement algorithms for triangular mesh generation , 2002, Comput. Geom..

[11]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[12]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Baining Guo,et al.  Geometry-driven photorealistic facial expression synthesis , 2003, IEEE Transactions on Visualization and Computer Graphics.

[14]  Charlie D. Frowd,et al.  Improving Target Identification Using Pairs of Composite Faces Constructed by the Same Person , 2006 .

[15]  Satoshi Kondo,et al.  An Image Completion Algorithm Using Occlusion-Free Images from Internet Photo Sharing Sites , 2008, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..