SEMINARS IN STATISTICS @ COLLEGIO CARLO ALBERTO https://www.google.com/url?q=https://www.carloalberto.org/events/category/seminars/seminars-in-statistics/page/2/?tribe-bar-date%3D2019-09-01&source=gmail-imap&ust=1732719071000000&usg=AOvVaw1_VfRy4qDP_HHioNc49JU_

Venerdì 14/02/2025, presso il Collegio Carlo Alberto, in Piazza Arbarello 8, Torino, si terrà il seguente seminario:

------------------------------------------------

12.00-13.00

Speaker: Yufei ZHANG (IMPERIAL COLLEGE LONDON)

Title: Towards sample-efficient continuous-time reinforcement learning

Abstract: Recently, reinforcement learning (RL) has garnered significant research interest. However, much of this attention and success has been focused on the discrete-time setting. RL for continuous-time systems, despite its natural applicability to a wide range of control tasks in physical systems, remains largely unexplored with limited progress. In particular, characterizing the sample efficiency of continuous-time RL algorithms continues to be a challenging and open problem. In this talk, we introduce a principled framework for systematically analyzing regret bounds for continuous-time RL algorithms in episodic model-based settings. Our framework decomposes the regret analysis into two fundamental components: the finite-sample accuracy of model estimation and the performance gap of a greedy policy derived from the estimated models. The finite-sample accuracy is analyzed using filtering theory and concentration inequalities for correlated observations, while the performance gap is quantified by leveraging the robustness of the control problem. By integrating these insights, we optimize the exploration-exploitation trade-off, achieving the best-known sample complexity in the current literature.

------------------------------------------------

Sarà possibile il seminario anche in streaming: chiunque volesse collegarsi è pregato di inviare una email entro *mercoledì 12/02/2025* a matteo.giordano@unito.it mailto:matteo.giordano@unito.it.

Il webinar è organizzato dalla "de Castro" Statistics Initiative (www.carloalberto.org/stats http://www.carloalberto.org/stats) in collaborazione con il Collegio Carlo Alberto.

Cordiali saluti,

Matteo Giordano Assistant Professor (RTDA) Department of Economics, Social Studies, Applied Mathematics and Statistics (ESOMAS) www.matteogiordano.weebly.com https://matteogiordano.weebly.com/