Cell-based shape reconstruction from incomplete silhouettes

Article type: Research Article

Authors: Slembrouck, Maarten^* | Veelaert, Peter | Van Cauwelaert, Dimitri | Van Hamme, David | Philips, Wilfried

Affiliations: TELIN-IPI, Faculty of Engineering and Architecture, Ghent University-imec, Ghent, Belgium

Correspondence: [*] Corresponding author: Maarten Slembrouck, TELIN-IPI, Faculty of Engineering and Architecture, Ghent University-imec, St-Pietersnieuwstraat 41, 9000, Ghent, Belgium. E-mail: [email protected].

Abstract: Shape reconstruction from images is one of the most widely adopted approaches to compute accurate 3D reconstructions of people or objects in a multi-camera environment. However, such algorithms are traditionally very sensitive to errors in the silhouettes due to imperfect foreground-background estimation or occluding objects appearing between the camera and the object of interest. We propose a novel algorithm that is still able to provide high quality reconstruction from incomplete silhouettes. At the core of the method is the partitioning of the reconstruction space in cells, i.e. regions with uniform camera and silhouette coverage properties. An iterative process is proposed which incrementally adds cells to the temporal reconstruction based on their potential to explain the observed silhouettes from different cameras. Experimental results are close to manually labelled approaches and outperform standard leave-M-out reconstruction techniques in terms of F1-score.

Keywords: Shape reconstruction, occlusion, multi-camera fusion

DOI: 10.3233/ICA-180597

Journal: Integrated Computer-Aided Engineering, vol. 26, no. 3, pp. 257-271, 2019