Overparametrization and the bias-variance dilemma

Series

Erasmus Econometric Institute Series
Speaker

Johannes Schmidt-Hieber (University of Twente)
Field

Econometrics, Operations Analytics, Data Science and Econometrics

Location

Erasmus University Rotterdam, Campus Woudestein, ET-14
Rotterdam
Date and time

April 17, 2025
12:00 - 13:00

Abstract

For several machine learning methods such as neural networks, good generalization performance has been reported in the overparametrized regime. In view of the classical bias-variance trade-off, this behavior is highly counterintuitive. We will present a general framework to establish universal lower bounds for the bias-variance trade-off. This is joint work with Alexis Derumigny (Delft).