$\nabla$-SDF: Learning Euclidean Signed Distance Functions Online with Gradient-Augmented Octree Interpolation and Neural Residual

Zhirui Dai1*, Qihao Qian1*, Tianxing Fan1, Nikolay Atanasov1
*Equal contribution 1University of California San Diego
Method Demo

Abstract

Estimation of signed distance functions (SDFs) from point cloud data has been shown to benefit many robot autonomy capabilities, including localization, mapping, motion planning, and control. Methods that support online and large-scale SDF reconstruction tend to rely on discrete volumetric data structures, which affect the continuity and differentiability of the SDF estimates. Recently, using implicit features, neural network methods have demonstrated high-fidelity and differentiable SDF reconstruction but they tend to be less efficient, can experience catastrophic forgetting and memory limitations in large environments, and are often restricted to truncated SDFs. This work proposes $\nabla$-SDF, a hybrid method that combines an explicit prior obtained from gradient-augmented octree interpolation with an implicit neural residual. Our method achieves non-truncated (Euclidean) SDF reconstruction with computational and memory efficiency comparable to volumetric methods and differentiability and accuracy comparable to neural network methods. Extensive experiments demonstrate that $\nabla$-SDF outperforms the state of the art in terms of accuracy and efficiency, providing a scalable solution for downstream tasks in robotics and computer vision.

Overview

Method Overview: a) We keep key frames with small overlap and those that maximize the surface coverage for training; b) with the selected key frames and the current frame, we generate three types of samples: surface points, perturbed points around the surface, and free-space points; c) to predict SDF, we first obtain an SDF prior \(d_{ga}(\mathbf{x})\) with gradient-augmented interpolation in a semi-sparse octree, where each octant vertex has estimated SDF value and gradient; d) a multi-resolution hash grid with an MLP decoder is used to obtain an SDF residual correction \(\delta_d(\mathbf{x})\); e) the SDF prior \(d_{ga}(\mathbf{x})\) and the SDF residual \(\delta_d(\mathbf{x})\) are combined as the final SDF prediction \(\hat{d}(\mathbf{x}) = d_{ga}(\mathbf{x}) + \delta_d(\mathbf{x})\), and the parameters are trained with three loss functions: reconstruction loss, Eikonal loss and projection loss.

Results