Learning to Extract a Video Sequence from a Single Motion-Blurred Image

Jin, Meiguang; Meishvili, Givi; Favaro, Paolo (June 2018). Learning to Extract a Video Sequence from a Single Motion-Blurred Image. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, Utah, United States. June 18 - June 22, 2018.

[img] Text
Jin_Learning_to_Extract_CVPR_2018_paper.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (3MB) | Request a copy

We present a method to extract a video sequence from a single motion-blurred image. Motion-blurred images are the result of an averaging process, where instant frames are accumulated over time during the exposure of the sensor. Unfortunately, reversing this process is nontrivial. Firstly, averaging destroys the temporal ordering of the frames. Secondly, the recovery of a single frame is a blind deconvolution task, which is highly ill-posed. We present a deep learning scheme that gradually reconstructs a temporal ordering by sequentially extracting pairs of frames. Our main contribution is to introduce loss functions invariant to the temporal order. This lets a neural network choose during training what frame to output among the possible combinations. We also address the ill-posedness of deblurring by designing a network with a large receptive field and implemented via resampling to achieve a higher computational efficiency. Our proposed method can successfully retrieve sharp image sequences from a single motion blurred image and can generalize well on synthetic and real datasets captured with different cameras.

Item Type:

Conference or Workshop Item (Paper)

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Jin, Meiguang; Meishvili, Givi and Favaro, Paolo

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

Language:

English

Submitter:

Xiaochen Wang

Date Deposited:

28 May 2019 15:42

Last Modified:

26 Oct 2019 13:25

BORIS DOI:

10.7892/boris.126523

URI:

https://boris.unibe.ch/id/eprint/126523

Actions (login required)

Edit item Edit item
Provide Feedback