Kadanoff Seminar - The role of scale in deep neural networks, Ethan Dyer, Google

2:30 pm VIA ZOOM

The role of scale in deep neural networks

Modern deep learning has made remarkable progress across a wide variety of domains. A key ingredient to this success has been increasingly big models trained on increasingly large datasets. I will discuss theoretical and empirical work attempting to understand how performance improves with scale and distinguishing problems which can be solved by scale alone from those where new ideas are needed.

Event Type

Seminars

May 17