Structure learning for 3D Point Cloud Generation from Single RGB Images - Université d'Évry
Article Dans Une Revue Computer Graphics Forum Année : 2023

Structure learning for 3D Point Cloud Generation from Single RGB Images

Tarek Ben Charrada
Hamid Laga

Résumé

3D point clouds can represent complex 3D objects of arbitrary topologies and with fine‐grained details. They are, however, hard to regress from images using convolutional neural networks, making tasks such as 3D reconstruction from monocular RGB images challenging. In fact, unlike images and volumetric grids, point clouds are unstructured and thus lack proper parameterization, which makes them difficult to process using convolutional operations. Existing point‐based 3D reconstruction methods that tried to address this problem rely on complex end‐to‐end architectures with high computational costs. Instead, we propose in this paper a novel mechanism that decouples the 3D reconstruction problem from the structure (or parameterization) learning task, making the 3D reconstruction of objects of arbitrary topologies tractable and thus easier to learn. We achieve this using a novel Teacher‐Student network where the Teacher learns to structure the point clouds. The Student then harnesses the knowledge learned by the Teacher to efficiently regress accurate 3D point clouds. We train the Teacher network using 3D ground‐truth supervision and the Student network using the Teacher's annotations. Finally, we employ a novel refinement network to overcome the upper‐bound performance that is set by the Teacher network. Our extensive experiments on ShapeNet and Pix3D benchmarks, and on in‐the‐wild images demonstrate that the proposed approach outperforms previous methods in terms of reconstruction accuracy and visual quality.
Fichier non déposé

Dates et versions

hal-04270988 , version 1 (05-11-2023)

Identifiants

Citer

Tarek Ben Charrada, Hamid Laga, Hedi Tabia. Structure learning for 3D Point Cloud Generation from Single RGB Images. Computer Graphics Forum, 2023, 42 (7), pp.e14942. ⟨10.1111/cgf.14942⟩. ⟨hal-04270988⟩
98 Consultations
0 Téléchargements

Altmetric

Partager

More