TR2004-050

Non-Photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging


    •  Raskar, R., Tan, K.-H., Feris, R., Yu, J., Turk, M., "Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging", ACM SIGGRAPH, August 2004, vol. 23, pp. 679-688.
      BibTeX TR2004-050 PDF
      • @inproceedings{Raskar2004aug3,
      • author = {Raskar, R. and Tan, K.-H. and Feris, R. and Yu, J. and Turk, M.},
      • title = {Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging},
      • booktitle = {ACM SIGGRAPH},
      • year = 2004,
      • volume = 23,
      • number = 3,
      • pages = {679--688},
      • month = aug,
      • issn = {0730-0301},
      • url = {https://www.merl.com/publications/TR2004-050}
      • }
  • Research Area:

    Computer Vision

Abstract:

We present a non-photorealistic rendering approach to capture and convey shape features of real-world scenes. We use a camera with multiple flashes that are strategically positioned to cast shadows along depth discontinuities in the scene. The projective-geometric relationship of the camera-flash setup is then exploited to detect depth discontinuities and distinguish them from intensity edges due to material discontinuities.

We introduce depiction methods that utilize the detected edge features to generate stylized static and animated images. We can highlight the detected features, suppress unnecessary details or combine features from multiple images. The resulting images more clearly convey the 3D structure of the imaged scenes.

We take a very different approach to capturing geometric features of a scene than traditonal approaches that require reconstructing a 3D model. This results in a method that is both surprisingly simple and computationally efficient. The entire hardware/software setup can conceivably be packaged into a self-contained device no larger than existing digital cameras.

 

  • Related News & Events

    •  NEWS    ACM SIGGRAPH 2004: 3 publications by Paul Beardsley, Jeroen van Baar, Paul Dietz, Ramesh Raskar, Darren Leigh and Hanspeter Pfister
      Date: August 8, 2004
      Where: ACM SIGGRAPH
      Research Area: Computer Vision
      Brief
      • The papers "3D TV: A Scalable System for Real-Time Acquisition, Transmission and Autostereoscopic Display of Dynamic Scenes" by Matusik, W. and Pfister, H., "RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors" by Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P.H., Lee, J., Leigh, D. and Willwacher, T. and "Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-Flash Imaging" by Raskar, R., Tan, K.-H., Feris, R., Yu, J. and Turk, M. were presented at ACM SIGGRAPH.
    •