Learning to See through Reflections

Jin, Meiguang; Süsstrunk, Sabine; Favaro, Paolo (May 2018). Learning to See through Reflections. In: IEEE International Conference on Computational Photography 2018. Pittsburgh, PA, United States. May 4 - May 6, 2018. 10.1109/ICCPHOT.2018.8368464

[img] Text
08368464.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (2MB) | Request a copy

Pictures of objects behind a glass are difficult to interpret and understand due to the superposition of two real images: a reflection layer and a background layer. Separation of these two layers is challenging due to the ambiguities in assigning texture patterns and the average color in the input image to one of the two layers. In this paper, we propose a novel method to reconstruct these layers given a single input image by explicitly handling the ambiguities of the reconstruction. Our approach combines the ability of neural networks to build image priors on large image regions with an image model that accounts for the brightness ambiguity and saturation. We find that our solution generalizes to real images even in the presence of strong reflections. Extensive quantitative and qualitative experimental evaluations on both real and synthetic data show the benefits of our approach over prior work. Moreover, our proposed neural network is computationally and memory efficient.

Item Type:

Conference or Workshop Item (Paper)


08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Jin, Meiguang and Favaro, Paolo


000 Computer science, knowledge & systems
500 Science > 510 Mathematics




Xiaochen Wang

Date Deposited:

29 May 2019 10:46

Last Modified:

29 Oct 2019 18:30

Publisher DOI:






Actions (login required)

Edit item Edit item
Provide Feedback