Temporally coherent disparity maps using CRFs with fast 4D filtering

Arjomand, Siavash; Budweiser, Gregor; Zwicker, Matthias (2016). Temporally coherent disparity maps using CRFs with fast 4D filtering. IPSJ Transactions on Computer Vision and Applications, 8(1) Springer 10.1186/s41074-016-0011-2

art%3A10.1186%2Fs41074-016-0011-2.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (1MB) | Preview

State-of-the-art methods for disparity estimation achieve good results for single stereo frames, but temporal coherence in stereo videos is often neglected. In this paper, we present a method to compute temporally coherent disparity maps. We define an energy over whole stereo sequences and optimize their conditional random field (CRF) distributions using the mean-field approximation. In addition, we introduce novel terms for smoothness and consistency between the left and right views. We perform CRF optimization by fast, iterative spatio-temporal filtering with linear complexity in the total number of pixels. We propose two CRF optimization techniques, using parallel and sequential updates, and compare them in detail. While parallel updates are not guaranteed to converge, we show that, in practice with appropriate initialization, they provide the same quality as sequential updates and they also lead to faster implementations. Finally, we demonstrate that the results of our approach rank among the state of the art while having significantly less flickering artifacts in stereo sequences.

Item Type: Journal Article (Original Article)
Division/Institute: 08 Faculty of Science > Institute of Computer Science (INF) > Computer Graphics Group (CGG)
08 Faculty of Science > Institute of Computer Science (INF)
UniBE Contributor: Arjomand, Siavash; Budweiser, Gregor and Zwicker, Matthias
Subjects: 000 Computer science, knowledge & systems
500 Science > 510 Mathematics
ISSN: 1882-6695
Publisher: Springer
Funders: [104] Commission for Technology and Innovation (CTI)
Language: English
Submitter: Matthias Zwicker
Date Deposited: 14 Feb 2017 11:43
Last Modified: 19 Feb 2017 02:16
Publisher DOI: 10.1186/s41074-016-0011-2
BORIS DOI: 10.7892/boris.95083
URI: http://boris.unibe.ch/id/eprint/95083

Actions (login required)

Edit item Edit item
Provide Feedback