Non-line-of-sight imaging

Daniele Faccio; Andreas Velten; Gordon Wetzstein

doi:10.1038/s42254-020-0174-8

Non-line-of-sight imaging

Daniele Faccio, Andreas Velten, Gordon Wetzstein

Research output: Contribution to journal › Article › peer-review

165 Scopus citations

Abstract

Emerging single-photon-sensitive sensors produce picosecond-accurate time-stamped photon counts. Applying advanced inverse methods to process these data has resulted in unprecedented imaging capabilities, such as non-line-of-sight (NLOS) imaging. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, NLOS methods analyse photons that travel along indirect light paths, scattered from multiple surfaces, to estimate 3D images of scenes outside the direct line of sight of a camera, hidden by a wall or other obstacles. We review the transient imaging techniques that underlie many NLOS imaging approaches, discuss methods for reconstructing hidden scenes from time-resolved measurements, describe some other methods for NLOS imaging that do not require transient imaging and discuss the future of ‘seeing around corners’.

Original language	English (US)
Pages (from-to)	318-327
Number of pages	10
Journal	Nature Reviews Physics
Volume	2
Issue number	6
DOIs	https://doi.org/10.1038/s42254-020-0174-8
State	Published - May 13 2020
Externally published	Yes

Bibliographical note

KAUST Repository Item: Exported on 2022-06-14
Acknowledgements: G.W. and A.V. acknowledge financial support from DARPA REVEAL (HR0011-16-C-0025). G.W. is supported by NSF CAREER Award (IIS 1553333), PECASE (ARO, W911NF19-1-0120) and the Visual Computing Center CCF grant (KAUST Office of Sponsored Research). D.F. is supported by the Royal Academy of Engineering under the Chairs in Emerging Technologies scheme and by the EPSRC (UK, grant no. EP/T00097X/1).
This publication acknowledges KAUST support, but has no KAUST affiliated authors.

Access to Document

10.1038/s42254-020-0174-8

Cite this

@article{14165fb9190e40cba1992e4e7b5a860b,

title = "Non-line-of-sight imaging",

abstract = "Emerging single-photon-sensitive sensors produce picosecond-accurate time-stamped photon counts. Applying advanced inverse methods to process these data has resulted in unprecedented imaging capabilities, such as non-line-of-sight (NLOS) imaging. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, NLOS methods analyse photons that travel along indirect light paths, scattered from multiple surfaces, to estimate 3D images of scenes outside the direct line of sight of a camera, hidden by a wall or other obstacles. We review the transient imaging techniques that underlie many NLOS imaging approaches, discuss methods for reconstructing hidden scenes from time-resolved measurements, describe some other methods for NLOS imaging that do not require transient imaging and discuss the future of {\textquoteleft}seeing around corners{\textquoteright}.",

author = "Daniele Faccio and Andreas Velten and Gordon Wetzstein",

note = "KAUST Repository Item: Exported on 2022-06-14 Acknowledgements: G.W. and A.V. acknowledge financial support from DARPA REVEAL (HR0011-16-C-0025). G.W. is supported by NSF CAREER Award (IIS 1553333), PECASE (ARO, W911NF19-1-0120) and the Visual Computing Center CCF grant (KAUST Office of Sponsored Research). D.F. is supported by the Royal Academy of Engineering under the Chairs in Emerging Technologies scheme and by the EPSRC (UK, grant no. EP/T00097X/1). This publication acknowledges KAUST support, but has no KAUST affiliated authors.",

year = "2020",

month = may,

day = "13",

doi = "10.1038/s42254-020-0174-8",

language = "English (US)",

volume = "2",

pages = "318--327",

journal = "Nature Reviews Physics",

issn = "2522-5820",

publisher = "Springer International Publishing",

number = "6",

}

TY - JOUR

T1 - Non-line-of-sight imaging

AU - Faccio, Daniele

AU - Velten, Andreas

AU - Wetzstein, Gordon

N1 - KAUST Repository Item: Exported on 2022-06-14 Acknowledgements: G.W. and A.V. acknowledge financial support from DARPA REVEAL (HR0011-16-C-0025). G.W. is supported by NSF CAREER Award (IIS 1553333), PECASE (ARO, W911NF19-1-0120) and the Visual Computing Center CCF grant (KAUST Office of Sponsored Research). D.F. is supported by the Royal Academy of Engineering under the Chairs in Emerging Technologies scheme and by the EPSRC (UK, grant no. EP/T00097X/1). This publication acknowledges KAUST support, but has no KAUST affiliated authors.

PY - 2020/5/13

Y1 - 2020/5/13

N2 - Emerging single-photon-sensitive sensors produce picosecond-accurate time-stamped photon counts. Applying advanced inverse methods to process these data has resulted in unprecedented imaging capabilities, such as non-line-of-sight (NLOS) imaging. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, NLOS methods analyse photons that travel along indirect light paths, scattered from multiple surfaces, to estimate 3D images of scenes outside the direct line of sight of a camera, hidden by a wall or other obstacles. We review the transient imaging techniques that underlie many NLOS imaging approaches, discuss methods for reconstructing hidden scenes from time-resolved measurements, describe some other methods for NLOS imaging that do not require transient imaging and discuss the future of ‘seeing around corners’.

AB - Emerging single-photon-sensitive sensors produce picosecond-accurate time-stamped photon counts. Applying advanced inverse methods to process these data has resulted in unprecedented imaging capabilities, such as non-line-of-sight (NLOS) imaging. Rather than imaging photons that travel along direct paths from a source to an object and back to the detector, NLOS methods analyse photons that travel along indirect light paths, scattered from multiple surfaces, to estimate 3D images of scenes outside the direct line of sight of a camera, hidden by a wall or other obstacles. We review the transient imaging techniques that underlie many NLOS imaging approaches, discuss methods for reconstructing hidden scenes from time-resolved measurements, describe some other methods for NLOS imaging that do not require transient imaging and discuss the future of ‘seeing around corners’.

UR - http://hdl.handle.net/10754/678957

UR - http://www.nature.com/articles/s42254-020-0174-8

UR - http://www.scopus.com/inward/record.url?scp=85084561573&partnerID=8YFLogxK

U2 - 10.1038/s42254-020-0174-8

DO - 10.1038/s42254-020-0174-8

M3 - Article

SN - 2522-5820

VL - 2

SP - 318

EP - 327

JO - Nature Reviews Physics

JF - Nature Reviews Physics

IS - 6

ER -

Non-line-of-sight imaging

Abstract

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this