Aberration-Aware Depth-From-Focus

Research output: Contribution to journalArticlepeer-review


Computer vision methods for depth estimation usually use simple camera models with idealized optics. For modern machine learning approaches, this creates an issue when attempting to train deep networks with simulated data, especially for focus-sensitive tasks like Depth-from-Focus. In this work, we investigate the domain gap caused by off-axis aberrations that will affect the decision of the best-focused frame in a focal stack. We then explore bridging this domain gap through aberration-aware training (AAT). Our approach involves a lightweight network that models lens aberrations at different positions and focus distances, which is then integrated into the conventional network training pipeline. We evaluate the generality of network models on both synthetic and real-world data. The experimental results demonstrate that the proposed AAT scheme can improve depth estimation accuracy without fine-tuning the model for different datasets.
Original languageEnglish (US)
Pages (from-to)1-11
Number of pages11
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
StatePublished - Aug 4 2023

Bibliographical note

KAUST Repository Item: Exported on 2023-09-01
Acknowledgements: This work was supported by the King Abdullah University of Science and Technology (KAUST) individual baseline funding.


Dive into the research topics of 'Aberration-Aware Depth-From-Focus'. Together they form a unique fingerprint.

Cite this