2:30 pm VIA ZOOM
The role of scale in deep neural networks
Modern deep learning has made remarkable progress across a wide variety of domains. A key ingredient to this success has been increasingly big models trained on increasingly large datasets. I will discuss theoretical and empirical work attempting to understand how performance improves with scale and distinguishing problems which can be solved by scale alone from those where new ideas are needed.