Challenges in Disentangling Independent Factors of Variation

Szabo, Attila; Hu, Qiyang; Portenier, Tiziano; Zwicker, Matthias; Favaro, Paolo (April 2018). Challenges in Disentangling Independent Factors of Variation (arXiv). Cornell University

[img] Text
5333dd59139fb7b96d733d3bf025e9f5e3ab1834.pdf - Accepted Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (3MB)

We study the problem of building models that disentangle independent factors of variation. Such models encode features that can efficiently be used for classification and to transfer attributes between different images in image synthesis. As data we use a weakly labeled training set, where labels indicate what single factor has changed between two data samples, although the relative value of the change is unknown. This labeling is of particular interest as it may be readily available without annotation costs. We introduce an autoencoder model and train it through constraints on image pairs and triplets. We show the role of feature dimensionality and adversarial training theoretically and experimentally. We formally prove the existence of the reference ambiguity, which is inherently present in the disentangling task when weakly labeled data is used. The numerical value of a factor has different meaning in different reference frames. When the reference depends on other factors, transferring that factor becomes ambiguous. We demonstrate experimentally that the proposed model can successfully transfer attributes on several datasets, but show also cases when the reference ambiguity occurs.

Item Type:

Working Paper

Division/Institute:

08 Faculty of Science > Institute of Computer Science (INF)

UniBE Contributor:

Szabo, Attila, Hu, Qiyang, Portenier, Tiziano, Zwicker, Matthias, Favaro, Paolo

Subjects:

000 Computer science, knowledge & systems
500 Science > 510 Mathematics

Series:

arXiv

Publisher:

Cornell University

Language:

English

Submitter:

Xiaochen Wang

Date Deposited:

07 Jun 2019 14:40

Last Modified:

05 Dec 2022 15:26

ArXiv ID:

1711.02245v1

BORIS DOI:

10.7892/boris.126536

URI:

https://boris.unibe.ch/id/eprint/126536

Actions (login required)

Edit item Edit item
Provide Feedback