TR2005-058

Shadow Flow: A Recursive Method to Learn Moving Cast Shadows
Citation: Porikli, F.; Thornton, J., "Shadow Flow: A Recursive Method to Learn Moving Cast Shadows", IEEE International Conference on Computer Vision (ICCV), ISSN: 1550-5499, Vol. 1, pp. 891-898, October 2005 (IEEE Xplore)
Date:July 2005
MERL Contacts:Fatih Porikli, Jay Thornton

We present a novel algorithm to detect and remove cast shadows in a video sequence by taking advantage of the statistical prevalence of the shadowed regions over the object regions. We model shadows using multivariate Gaussians. We apply a weak classifier as a pre-filter. We project shadow models into a quantized color space to update a shadow flow function. We use shadow flow, background models, and current frame to determine the shadow and object regions. This method has several advantages: It does not require a color space transformation. We pose the problem in the RGB color space, and we carry out the same analysis in other Cartesian spaces as well. It is data-driven and adapts to the changing shadow conditions. In other words, accuracy of our method is not limited by the present threshold values. Furthermore, it does not assume any 3D models for the target objects or tracking of the cast shadows between frames. Our results show that the detection performance is superior than the benchmark method.

 Read the full technical report (PDF: 1.8 MB)