Arjomand, Siavash; Budweiser, Gregor; Zwicker, Matthias (2016). Temporally coherent disparity maps using CRFs with fast 4D filtering. IPSJ Transactions on Computer Vision and Applications, 8(1) Springer 10.1186/s41074-016-0011-2
art%3A10.1186%2Fs41074-016-0011-2.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).
Download (1MB) | Preview
State-of-the-art methods for disparity estimation achieve good results for single stereo frames, but temporal coherence in stereo videos is often neglected. In this paper, we present a method to compute temporally coherent disparity maps. We define an energy over whole stereo sequences and optimize their conditional random field (CRF) distributions using the mean-field approximation. In addition, we introduce novel terms for smoothness and consistency between the left and right views. We perform CRF optimization by fast, iterative spatio-temporal filtering with linear complexity in the total number of pixels. We propose two CRF optimization techniques, using parallel and sequential updates, and compare them in detail. While parallel updates are not guaranteed to converge, we show that, in practice with appropriate initialization, they provide the same quality as sequential updates and they also lead to faster implementations. Finally, we demonstrate that the results of our approach rank among the state of the art while having significantly less flickering artifacts in stereo sequences.
|Item Type:||Journal Article (Original Article)|
|Division/Institute:||08 Faculty of Science > Institute of Computer Science (INF) > Computer Graphics Group (CGG)
08 Faculty of Science > Institute of Computer Science (INF)
|UniBE Contributor:||Arjomand, Siavash; Budweiser, Gregor and Zwicker, Matthias|
|Subjects:||000 Computer science, knowledge & systems
500 Science > 510 Mathematics
|Funders:|| Commission for Technology and Innovation (CTI)|
|Date Deposited:||14 Feb 2017 11:43|
|Last Modified:||19 Feb 2017 02:16|