Abstract
We propose an efficient method for reconstructing background fragments that are visible in at least one frame of the input video sequence; this method can aid in filling disoccluded areas during view synthesis. We make no assumptions regarding background or camera motion except that it is smooth. The proposed method can therefore handle a wide variety of scenes captured with a free-moving camera. Our approach relies on formulating the problem as frame-by-frame global energy minimization, which we can efficiently solve given that the previous frame provides a good initial approximation. We compare our approach with a commercial background-reconstruction tool for view synthesis and with a general-purpose video-completion algorithm.