Mitsubishi Electric Research Laboratories

Factored Time-Lapse Video

Citation:   *  Sunkavalli, K; Matusik, W.; Pfister, H.; Rusinkiewicz, S., "Factored Time-Lapse Video", ACM Transactions on Graphics (TOG), ISSN:0730-0301, Vol. 26, Issue 3, Article 101, July 2007 (ACM Press)
MERL Report:  TR2007-117


We decompose a time-lapse sequence of photographs (a) into sun, sky, shadow, and reflectance components. The representation permits re-rendering without shadows (b) and without skylight (c), or modifying the reflectance of surfaces in the scene (d).

We describe a method for converting time-lapse photography captured with outdoor cameras into Factored Time-Lapse Video (FTLV): a video in which time appears to move faster (i.e., lapsing) and where data at each pixel has been factored into shadow, illumination, and reflectance components. The factorization allows a user to easily relight the scene, recover a portion of the scene geometry (normals), and to perform advanced image editing operations. Our method is easy to implement, robust, and provides a compact representation with good reconstruction characteristics. We show results using several publicly available time-lapse sequences.

 Read the full technical report (PDF: 6.2 MB)