Motion Deblurring in the Wild

Noroozi, Mehdi; Chandramouli, Paramanand; Favaro, Paolo (2017). Motion Deblurring in the Wild. In: Roth, Volker; Vetter, Thomas (eds.) German Conference on Pattern Recognition 2017. Lecture Notes in Computer Science: Vol. 10496 (pp. 65-77). Springer

Text Motion Deblurring in the Wild.pdf - Published Version Restricted to registered users only Available under License Publisher holds Copyright. Download (3MB)

We propose a deep learning approach to remove motion blur from a single image captured in the wild, i.e., in an uncontrolled setting. Thus, we consider motion blur degradations that are due to both camera and object motion, and by occlusion and coming into view of objects. In this scenario, a model- based approach would require a very large set of parameters, whose fitting is a challenge on its own. Hence, we take a data-driven approach and design both a novel convolutional neural network architecture and a dataset for blurry images with ground truth. The network produces directly the sharp image as output and is built into three pyramid stages, which allow to remove blur gradually from a small amount, at the lowest scale, to the full amount, at the scale of the input image. To obtain corresponding blurry and sharp image pairs, we use videos from a high frame-rate video camera. For each small video clip we select the central frame as the sharp image and use the frame average as the corresponding blurred image. Finally, to ensure that the averaging process is a sufficient approximation to real blurry images we estimate optical flow and select frames with pixel displacements smaller than a pixel. We demonstrate state of the art performance on datasets with both synthetic and real images.

Interest & Impact

Downloads

1 since deposited on 20 Apr 2018
0 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item