BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis

GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstruction

“…(RefV) with our backbone, appearance effects such as view dependencies or reflections are sometimes wrongly represented by inacurrate geometry. These limitations are also common in recent methods such as BakedSDF [44], as we can see in Fig. 7.…”

“…Recently, Ref-NeRF [37] reparameterizes the appearance prediction with separate diffuse and reflective components by using the reflected view direction, which improves the rendering of specular surfaces. As a result, recent works such as BakedSDF [44] or EN-VIDR [18] adopt this representation to reconstruct glossy surfaces of unbounded scenes and with material decomposition, respectively. While leading to strong view-synthesis results for reflective areas, we find that reflective radiance field approaches often lead to overly smooth reconstructions with missing details and that their optimization is not stable on real-world scenes.…”

“…Baselines. We compare our method to state-of-the-art methods in view synthesis [3,4,24,37] and implicit reconstruction [17,18,32,44]. Zip-NeRF [4] and Neuralangelo [17] are hash grid-based top performing methods for view synthesis and reconstruction, respectively.…”

“…3D meshes from reconstruction methods can be used in many downstream applications, e.g. scene understanding, robotics, and creating 3D experiences for augmented/virtual reality [31,44]. Typical aspects of real-world scenes such as uniformly colored areas or non-Lambertian surfaces remain challenging.…”

“…To better capture the appearance of reflective surfaces, Ref-NeRF [37] computes the color with separate diffuse and specular components and parameterizes the appearance using reflected view that exploits the surface normals. BakedSDF [44] adopts the same Ref-NeRF components with a VolSDF [43] backbone to reconstruct large-scale scenes with shiny surfaces. However, BakedSDF is slow to train and struggles with reconstructing fine details.…”