Department of

# Mathematics

Seminar Calendar
for Colloquium on Digital Transformation Science events the year of Saturday, April 10, 2021.

.
events for the
events containing

Questions regarding events or the calendar should be directed to Tori Corkery.
      March 2021             April 2021              May 2021
Su Mo Tu We Th Fr Sa   Su Mo Tu We Th Fr Sa   Su Mo Tu We Th Fr Sa
1  2  3  4  5  6                1  2  3                      1
7  8  9 10 11 12 13    4  5  6  7  8  9 10    2  3  4  5  6  7  8
14 15 16 17 18 19 20   11 12 13 14 15 16 17    9 10 11 12 13 14 15
21 22 23 24 25 26 27   18 19 20 21 22 23 24   16 17 18 19 20 21 22
28 29 30 31            25 26 27 28 29 30      23 24 25 26 27 28 29
30 31


Thursday, April 8, 2021

3:00 pm in Zoom,Thursday, April 8, 2021

#### Recent advances in analysis of implicit bias of gradient descent on deep networks

###### Matus Telgarsky (UIUC)

Abstract: The purpose of this talk is to highlight three recent directions in the study of implicit bias, a promising approach to developing a tight generalization theory for deep networks interwoven with optimization. The first direction is a warm-up with purely linear predictors: here, the implicit bias perspective gives the fastest known hard-margin SVM solver! The second direction is on the early training phase with shallow networks: here, implicit bias leads to good training and testing error, with not just narrow networks but also arbitrarily large ones. The talk concludes with deep networks, providing a variety of structural lemmas that capture foundational aspects of how weights evolve for any width and sufficiently large amounts of training. This is joint work with Ziwei Ji.

To register: https://berkeley.zoom.us/webinar/register/WN_iEXcldw1QPOuUofhS0WT4g