Video Inpainting Patch Propagation of Frames

Abstract

Video inpainting technique is that repairs damaged area or remove areas in an video. In order to deal with this kind of problems, not only a robust video inpainting algorithm should be used, technique of structure generation is also needs to adopt in inpainting procedure. In this paper, the exemplar-based video inpainting method is extended by incorporating the sparsity of natural image patches. Patch priority and patch representations which are two crucial steps for patch propagation in the extended examplar-based inpainting approach. First, patch structure sparsity is designed to measure the confidence of a patch located at the image structure (e.g., the edge or corner) by the sparseness of its nonzero similarities to the neighboring patches. The patch with larger structure sparsity will be assigned higher priority for further inpainting. Second, it is assumed that the patch to be filled can be represented by the sparse linear combination of candidate patches under the local patch consistency constraint in a framework of sparse representation. The main procedures of the proposed examplar-based inpainting algorithm is based on patch propagation by inwardly propagating the image patches from the source region into the interior of the target region patch by patch. In each iteration of patch propagation, the algorithm is decomposed into two procedures: patch selection and patch inpainting.