TR2006-087

Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination


    •  Nayar, S.K., Krishnan, G., Grossberg, M.D., Raskar, R., "Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination", ACM Transactions on Graphics (TOG), Vol. 25, No. 3, pp. 935-944, July 2006.
      BibTeX TR2006-087 PDF
      • @article{Nayar2006jul,
      • author = {Nayar, S.K. and Krishnan, G. and Grossberg, M.D. and Raskar, R.},
      • title = {Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination},
      • journal = {ACM Transactions on Graphics (TOG)},
      • year = 2006,
      • volume = 25,
      • number = 3,
      • pages = {935--944},
      • month = jul,
      • issn = {0730-0301},
      • url = {https://www.merl.com/publications/TR2006-087}
      • }
  • Research Area:

    Computer Vision

Abstract:

We present fast methods for separating the direct and global illumination components of a scene measured by a camera and illuminated by a light source. In theory, the separation can be done with just two images taken with a high frequency binary illumination pattern and its complement. In practice, a larger number of images are used to overcome the optical and resolution limitations of the camera and the source. The approach does not require the material properties of objects and media in the scene to be known. However, we require that the illumination frequency is high enough to adequately sample the global components received by scene points. We present separation results for scenes that include complex interreflections, subsurface scattering and volumetric scattering. Several variants of the separation approach are also described. When a sinusoidal illumination pattern is used with different phase shifts, the separation can be done using just three images. When the computed images are of lower resolution than the source and the camera, smoothness constraints are used to perform the separation using a single image. Finally, in the case of a static scene that is lit by a simple point source, such as the sun, a moving occluder and a video camera can be used to do the separation. We also show several simple examples of how novel images of a scene can be computed from the separation results.

 

  • Related News & Events

    •  NEWS    ACM Transactions on Graphics (TOG): 7 publications by Amit Agrawal, Ramesh Raskar and others
      Date: July 15, 2006
      Where: ACM Transactions on Graphics (TOG)
      Research Area: Computer Vision
      Brief
      • The articles "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter" by Raskar, R., Agrawal, A. and Tumblin, J., "Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination" by Nayar, S.K., Krishnan, G., Grossberg, M.D. and Raskar, R., "Analysis of Human Faces using a measurement-Based Skin Reflectance Model" by Weyrich, T., Matusik, W., Pfister, H., Bickel, B., Donner, C., Tu, C., McAndless, J., Lee, J., Ngan, A., Jensen, H. and Gross, M., "Inverse Shade Trees for Non-Parametric Material Representation and Editing" by Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R. and Rusinkiewicz, S., "A Compact Factored Representation of Heterogeneous Subsurface Scattering" by Peers, P., Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S. and Dutre, P., "Time-Varying Surface Appearance: Acquisition, Modeling and Rendering" by Gu, J., Tu, C., Ramamoorthi, R., Belhumeur, P., Matusik, W. and Nayar, S. and "A Statistical Model for Synthesis of Detailed Facial Geometry" by Golovinskiy, A., Matusik, W., Pfister, H., Rusinkiewicz, S. and Funkhouser, T. were published in ACM Transactions on Graphics (TOG).
    •