TR2005-071

A Measurement-Based Skin Reflectance Model for Face Rendering and Editing


    •  T. Weyrich, W. Matusik, H. Pfister, J. Lee, A. Ngan, H.W. Jensen, M. Gross, "A Measurement-Based Skin Reflectance Model for Face Rendering and Editing", Tech. Rep. TR2005-071, Mitsubishi Electric Research Laboratories, Cambridge, MA, July 2005.
      BibTeX TR2005-071 PDF
      • @techreport{MERL_TR2005-071,
      • author = {T. Weyrich, W. Matusik, H. Pfister, J. Lee, A. Ngan, H.W. Jensen, M. Gross},
      • title = {A Measurement-Based Skin Reflectance Model for Face Rendering and Editing},
      • institution = {MERL - Mitsubishi Electric Research Laboratories},
      • address = {Cambridge, MA 02139},
      • number = {TR2005-071},
      • month = jul,
      • year = 2005,
      • url = {https://www.merl.com/publications/TR2005-071/}
      • }
  • Research Area:

    Computer Vision

Abstract:

We present a novel skin reflectance model for faces and its application to face appearance editing. We decompose the high-dimensional bidirectional scattering surface reflectance distribution function (BSSRDF) of skin into components that can be estimated from measured data. Our model is intuitive, amenable to interactive rendering, and easy to edit. High-quality renderings come close to reproducing real photographs. We have measured 3D face geometry, skin reflectance, and subsurface scattering for a large group of people using custom-built devices and fit the data to our model. The analysis of the reflectance data reveals variations according to subject age, race, gender and external factors (heat, cold, makeup, etc.) We derive a low-dimensional model using non-negative matrix factorization (NMF) that spans the space of skin reflectance in our database. A user can define meaningful parameters in this space - such as race, gender, and age - and change the overall appearance of a person (e.g., making a Caucasian face look more Asian) or change local features (e.g., adding moles, freckles or hair follicles).