Understanding Degeneracies and Ambiguities in Attribute Transfer

Szabo, Attila; Hu, Qiyang; Portenier, Tiziano; Zwicker, Matthias; Favaro, Paolo (September 2018). Understanding Degeneracies and Ambiguities in Attribute Transfer. In: European Conference on Computer Vision 2018. Munich, Germany. Sep. 8 - Sep. 14, 2018.

[img] Text
Attila_Szabo_Understanding_Degeneracies_and_ECCV_2018_paper.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (1MB) | Request a copy

We study the problem of building models that can transfer selected attributes from one image to another without affecting the other attributes. Towards this goal, we develop analysis and a training methodology for autoencoding models, whose encoded features aim to disentangle attributes. These features are explicitly split into two components: one that should represent attributes in common between pairs of images, and another that should represent attributes that change between pairs of images. We show that achieving this objective faces two main challenges: One is that the model may learn degenerate mappings, which we call shortcut problem, and the other is that the attribute representation for an image is not guaranteed to follow the same interpretation on another image, which we call reference ambiguity. To address the shortcut problem, we introduce novel constraints on image pairs and triplets and show their effectiveness both analytically and experimentally. In the case of the reference ambiguity, we formally prove that a model that guarantees an ideal feature separation cannot be built. We validate our findings on several datasets and show that, surprisingly, trained neural networks often do not exhibit the reference ambiguity.

Item Type:

Conference or Workshop Item (Paper)

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Szabo, Attila; Hu, Qiyang; Portenier, Tiziano; Zwicker, Matthias and Favaro, Paolo

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

Language:

English

Submitter:

Xiaochen Wang

Date Deposited:

28 May 2019 15:28

Last Modified:

05 Nov 2019 14:03

BORIS DOI:

10.7892/boris.126512

URI:

https://boris.unibe.ch/id/eprint/126512

Actions (login required)

Edit item Edit item
Provide Feedback