Monocular, boundary-preserving joint recovery of scene flow and depth

Mathlouthi, Yosra, Mitiche, Amar and Ben Ayed, Ismail. 2016. « Monocular, boundary-preserving joint recovery of scene flow and depth ». Frontiers in ICT, vol. 3, nº 21.

Preview

PDF Ben Ayed I 2016 14354.pdf - Published Version Use licence: Creative Commons CC BY. Download (10MB) | Preview

Abstract

Variational joint recovery of scene flow and depth from a single image sequence, rather than from a stereo sequence as others required, was investigated in Mitiche et al. (2015) using an integral functional with a term of conformity of scene flow and depth to the image sequence spatiotemporal variations, and L 2 regularization terms for smooth depth field and scene flow. The resulting scheme was analogous to the Horn and Schunck optical flow estimation method, except that the unknowns were depth and scene flow rather than optical flow. Several examples were given to show the basic potency of the method: it was able to recover good depth and motion, except at their boundaries because L 2 regularization is blind to discontinuities which it smooths indiscriminately. The method that we study in this paper generalizes to L 1 regularization the formulation of Mitiche et al. (2015) so that it computes boundary-preserving estimates of both depth and scene flow. The image derivatives, which appear as data in the functional, are computed from the recorded image sequence also by a variational method, which uses L 1 regularization to preserve their discontinuities. Although L 1 regularization yields non-linear Euler–Lagrange equations for the minimization of the objective functional, these can be solved efficiently. The advantages of the generalization, namely, sharper computed depth and three-dimensional motion, are put in evidence in experimentation with real and synthetic images, which shows the results of L 1 versus L 2 regularization of depth and motion, as well as the results using L 1 rather than L 2 regularization of image derivatives.

Item Type:	Peer reviewed article published in a journal
Professor:	Professor Ben Ayed, Ismail
Affiliation:	Génie de la production automatisée
Date Deposited:	23 Jan 2017 15:49
Last Modified:	19 Oct 2020 18:29
URI:	https://espace2.etsmtl.ca/id/eprint/14354

Actions (login required)

View Item