Skip to content
AI Atlas
PaperActive

Configuration-Dependent Lower Bounds for Approximation by Shallow ReLU$^k$ Networks on the Sphere

arxiv.org/abs/2510.04060

quality89

Updated 3 h ago · first seen 11 Sept 2026

paper_01M294FSW37JD5WBYWHNVKN941

Published
11 Sept 2026
T1 · 3 h ago
arXiv
2510.04060
T1 · 3 h ago
Category
math.NA
T1 · 3 h ago

Abstract

-cross Abstract: We establish two related but logically distinct results for shallow ReLU$^k$ neural networks on the unit sphere $\SS^d$. First, for an arbitrary set of inner neural-network parameters, the best $\mathcal{L}^2(\SS^d)$ approximation of a fixed target function with smoothness $r>\tfrac{d+2k+1}{2}$ admits an asymptotic lower bound given by a constant multiple of $n^{-1/2}\underline{h}^{k+1/2}$, where $\underline{h}$ denotes the antipodal separation distance of the normalized inner-parameter set. This lower bound depends explicitly on the parameter configuration through $\underline{h}$ and applies without additional assumptions on the parameters. Second, for antipodally quasi-uniform parameters, $\underline{h}\simeq n^{-1/d}$, and the lower bound establishes the exact saturation order $n^{-\frac{d+2k+1}{2d}}$ for such parameter families: a target function with regularity greater than $\frac{d+2k+1}{2}$ and satisfying the required parity condition can be approximated at this rate, whereas approximation at any strictly faster rate forces the target function to be zero. Our results therefore place linearized neural-network approximation within the classical saturation framework and show that, although ReLU$^k$ network spaces can outperform finite elements of the same degree, this advantage is intrinsically limited.

Authors 2

Tong Mao, Jinchao Xu

Specification

Official page

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

Arxiv announce type
replace

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

arXiv id
2510.04060

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

Categories
math.NA, cs.LG, cs.NA

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

PDF

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

Primary category
math.NA

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

Published
11 Sept 2026

Source:arXiv (Atom API + RSS)T1observed 3 h agohigh

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

9

Source tiers

T19

Freshest observation

3 h ago

Conflicts

None