Two is Better than One: Achieving High-Quality 3D Scene Modeling with a NeRF Ensemble

Francesco Di Sario , Riccardo Renzulli , Enzo Tartaglione (1, 2) , Marco Grangetto

1 IDS - Département Images, Données, Signal
2 MM - Multimédia

Neural Radiance Field (NeRF) is a popular method for synthesizing novel views of a scene from a set of input images. While NeRF has demonstrated state-of-the-art performance in several applications, it suffers from high computational requirements. Recent works have attempted to address these issues by including explicit volumetric information, which makes the optimization process difficult when fine-graining the voxel grids. In this paper, we propose an ensemble approach that combines the strengths of two NeRF models to achieve superior results compared to state-of-the-art architectures, with a similar number of parameters. Experimental results show that our ensemble approach is a promising strategy for performance enhancement, and beats vanilla approaches under the same parameter’s cardinality constraint.

Keywords: NeRF Ensemble 3D scene modeling Compression; NeRF; Ensemble; 3D scene modeling; Compression

Domains: Computer Science [cs]

Francesco Di Sario, Riccardo Renzulli, Enzo Tartaglione, Marco Grangetto. Two is Better than One: Achieving High-Quality 3D Scene Modeling with a NeRF Ensemble. Image Analysis and Processing – ICIAP 2023, 14234, Springer Nature Switzerland, pp.320-331, 2023, Lecture Notes in Computer Science, ⟨10.1007/978-3-031-43153-1_27⟩. ⟨hal-04205640⟩