TR2010-027

Reinterpretable Imager: Towards Variable Post-Capture Space, Angle and Time Resolution in Photography


    •  Agrawal, A.K.; Veeraraghavan, A.N.; Raskar, R., "Reinterpretable Imager: Towards Variable Post-Capture Space, Angle and Time Resolution in Photography", Eurographics, May 2010.
      BibTeX Download PDF
      • @inproceedings{Agrawal2010may,
      • author = {Agrawal, A.K. and Veeraraghavan, A.N. and Raskar, R.},
      • title = {Reinterpretable Imager: Towards Variable Post-Capture Space, Angle and Time Resolution in Photography},
      • booktitle = {Eurographics},
      • year = 2010,
      • month = may,
      • url = {http://www.merl.com/publications/TR2010-027}
      • }
  • Research Areas:

    Computational Photography, Computer Vision


We describe a novel multiplexing approach to achieve tradeoffs in space, angle and time resolution in photography. We explore the problem of mapping useful subsets of time-varying 4D lightfields in a single snapshot. Our design is based on using a dynamic mask in the aperture and a static mask close to the sensor. The key idea is to exploit scene-specific redundancy along spatial, angular and temporal dimensions and to provide a programmable or variable resolution tradeoff among these dimensions. This allows a user to reinterpret the single captured photo as either a high spatial resolution image, a refocusable image stack or a video for different parts of the scene in post-processing. A lightfield camera or a video camera forces a-priori choice in space-angle-time resolution. We demonstrate a single prototype which provides flexible post-capture abilities not possible using either a single-shot lightfield camera or a multi-frame video camera. We show several novel results including digital refocusing on objects moving in depth and capturing multiple facial expressions in a single photo.