Post-Production Facial Performance Relighting Using Reflection Transfer
| Citation: | * Peers, P., Tamura, N.; Matusik, W.; Debevec, P, "Post-production Facial Performance Relighting using Reflectance Transfer", ACM Transactions on Graphics (TOG), ISSN: 0730-0301, Vol. 26, Issue 3, Article 52, July 2007 (ACM Press) |
| MERL Report: | TR2007-114 |
An iconic representation of the reflectance transfer algorithm.
We propose a novel post-production facial performance relighting system for human actors. Our system uses just a dataset of view-dependent facial appearances with a neutral expression, captured for a static subject using a Light Stage apparatus. For the actual performance, however, a potentially different actor is captured under known, but static, illumination. During post-production, the reflectance field of the reference dataset actor is transferred onto the dynamic performance, enabling image-based relighting of the entire sequence. Our approach makes post-production relighting more practical and could easily be incorporated in a traditional production pipeline since it does not require additional hardware during principal photography. Additionally, we show that our system is suitable for real-time post-production illumination editing.
 | Read the full technical report (PDF: 1 MB) |