Title: A robust framework for automated digital video inpainting

Authors: Suneet Grover, Ankush Mittal, Sumit Gupta, Anil K. Sarje, Nitin Kaushik

Addresses: Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, 247667 Roorkee, India. ' Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, 247667 Roorkee, India. ' Department of Computer Science and Engineering, MVGR College of Engineering, Vizianagaram, 530030 AP, India. ' Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, 247667 Roorkee, India. ' Department of Electronics and Computer Engineering, Indian Institute of Technology Roorkee, 247667 Roorkee, India

Abstract: In this paper, a novel method for filling-in the missing information in images and videos is proposed. The algorithm presented here is able to reconstruct the structure as well as the texture. The pixel values are chosen by interpolating and searching the similar patch in a small window in the input image, and are filled in an order depending on their confidence values. The approach for video inpainting involves the automated tracking of the object selected for removal, followed by filling-in the holes while enforcing the global spatio-temporal consistency. Experiments show the effectiveness of our algorithm in tracking and removing large occluding objects as well as thin scratches.

Keywords: Dirichlet boundary conditions; multimedia restoration; temporal coherency; texture filling; structure preservation; digital video inpainting; in-filling; object tracking; occluding objects; thin scratches.

DOI: 10.1504/IJSISE.2008.026790

International Journal of Signal and Imaging Systems Engineering, 2008 Vol.1 No.3/4, pp.185 - 196

Published online: 26 Jun 2009 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article