Characterization of the Variation Spaces Corresponding to Shallow Neural Networks

Jonathan W. Siegel*, Jinchao Xu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

We study the variation space corresponding to a dictionary of functions in L2(Ω) for a bounded domain Ω ⊂ Rd. Specifically, we compare the variation space, which is defined in terms of a convex hull with related notions based on integral representations. This allows us to show that three important notions relating to the approximation theory of shallow neural networks, the Barron space, the spectral Barron space, and the Radon BV space, are actually variation spaces with respect to certain natural dictionaries.

Original languageEnglish (US)
Pages (from-to)1109-1132
Number of pages24
JournalConstructive Approximation
Volume57
Issue number3
DOIs
StatePublished - Jun 2023

Bibliographical note

Funding Information:
We would like to thank Professors Russel Caflisch, Ronald DeVore, Weinan E, Albert Cohen, Stephan Wojtowytsch and Jason Klusowski for helpful discussions. We would also like to thank the anonymous reviewers for their helpful comments. This work was supported by the Verne M. Willaman Chair Fund at the Pennsylvania State University, and the National Science Foundation (Grant No. DMS-1819157 and DMS-2111387).

Funding Information:
We would like to thank Professors Russel Caflisch, Ronald DeVore, Weinan E, Albert Cohen, Stephan Wojtowytsch and Jason Klusowski for helpful discussions. We would also like to thank the anonymous reviewers for their helpful comments. This work was supported by the Verne M. Willaman Chair Fund at the Pennsylvania State University, and the National Science Foundation (Grant No. DMS-1819157 and DMS-2111387).

Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

Keywords

  • Approximation
  • Function space
  • Neural networks

ASJC Scopus subject areas

  • Analysis
  • General Mathematics
  • Computational Mathematics

Fingerprint

Dive into the research topics of 'Characterization of the Variation Spaces Corresponding to Shallow Neural Networks'. Together they form a unique fingerprint.

Cite this