Booster / Metric depth estimation
Recovering metric-scale geometry from observations at a single viewpoint remains fundamentally ill-posed, limiting the reliability of novel view synthesis. Recent methods rely on learned monocular depth priors, which provide strong structural estimates but can suffer from scale ambiguity and dataset-dependent biases. We propose DfD-GS, a feed-forward framework that predicts a metric-scale 3D Gaussian scene representation from a single-view all-in-focus–defocused image pair. The key idea is to exploit defocus blur as a physical metric depth cue. DfD-GS first estimates a defocus-based metric disparity map from the all-in-focus–defocused image pair and the corresponding defocus strength. This estimate is used to align and refine a monocular depth prior to metric scale. Visible and hidden 3D Gaussians are then predicted for occlusion-aware novel view synthesis. Experiments on synthetic-defocus datasets constructed from Booster and Middlebury show that DfD-GS outperforms single-image baselines in metric depth estimation and novel view synthesis. On WildRGB-D, DfD-GS achieves lower AbsRel and LPIPS but higher depth RMSE than the single-image baselines. Additional analyses show that DfD-GS maintains a more stable metric scale under field-of-view changes. Qualitative results on a real dataset show recovery of the main scene structure under optical defocus.

The method takes an all-in-focus–defocused image pair from the same viewpoint, with known camera intrinsics, defocus strength, and focus distance. The focus plane is placed at the nearest scene depth.
A frozen Depth Anything 3 backbone extracts multi-scale features and a relative geometry prior from the all-in-focus image. A defocus-conditioned U-Net estimates metric disparity offsets, which are used to globally align the prior. A learned scale map then refines the aligned disparity. The refined depth, input image, and DA3 features are used to predict visible and hidden 3D Gaussians for novel view synthesis.
@misc{ueda2026dfdgs,
title = {{DfD-GS}: Defocus Image Prior for Metric-Scale Single-View Depth Estimation and View Synthesis},
author = {Ueda, Shiori and Yagawa, Rinto and Saito, Hideo and Mori, Shohei},
year = {2026},
eprint = {2611.26072},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.26072}
}