Seminar Celli at Tor Vergata, 09.11
Dear all, On Monday, November 9, at 14h00 in Aula Dal Passo in the Math Department of the University of Rome Tor Vergata, RoMaDS (https://www.mat.uniroma2.it/~rds/events.php) will host Lucia Celli (University of Luxembourg) with the seminar “Quantitative CLTs for neural network at random initialization” Abstract: New quantitative bounds for the convergence of wide feed-forward neural networks to Gaussian processes are presented. For fully connected networks with i.i.d. weights and Gaussian biases, convergence at rate $O(n^{-1/2})$ is established in the Kolmogorov and Wasserstein distances when the network is evaluated at a single input, and in the convex distance when it is evaluated at multiple inputs, as the hidden-layer width $n \to \infty$. The bounds are explicit in the hyperparameters of the network and they give us the possibility to study the infinite depth-width limit. The main tool is Stein's method, following the approach of Chatterjee (2008) and subsequent extensions by Kasprzak, Peccati (2022) and Lachieze-Rey, Peccati (2017). The talk will focus on the proof of the Kolmogorov distance bound, where a key step consists in solving a Stein equation associated with the square of a Lipschitz function. We encourage in-person partecipation. Should you be unable to come, here is the link to the Teams streaming: https://teams.microsoft.com/meet/31063852152728?p=gXh2dasNv6Msd83RWS The seminar is part of the Excellence Project MatMod@TOV.
participants (1)
-
Michele Salvi