TR2014-026

Video background subtraction using semi-supervised robust matrix completion


TR Image
Background subtraction of four frames from the Bus sequence. Row one shows the original four frames. Row two shows the motion aligned and FRMC separated background relative to a 30 frame GOP. Row three shows the motion aligned and FRMC separated foreground. The total global motion compensation and back- ground subtraction for 150 frames is 19.8 seconds.
Abstract:

We propose a factorized robust matrix completion (FRMC) algorithm with global motion compensation to solve the video back- ground subtraction problem. The algorithm decomposes a sequence of video frames into the sum of a low rank background component and a sparse motion component. The algorithm alternates between the solution of each component following a Pareto curve trajectory for each subproblem. For videos with moving background, we utilize the motion vectors extracted from the coded video bitstream to compensate for the change in the camera perspective. Performance evaluations show that our approach is faster than state-of- the-art solvers and results in highly accurate motion segmentation.