Deep Double Descent
Ahmed Taha
0:00 / 0:00
Deep Double Descent
641 просмотр · 2 года назад
Ahmed Taha
738 подписчиков
641 просмотр · 2 года назад
This video presents Deep Double Descent: Where Bigger Models and More Data Hurt
arXiv paper https://arxiv.org/abs/1912.02292
The slides are available at https://bit.ly/3AwfIhe
0:00 Introduction
0:29 Double Descent
4:50 Effective Model Capacity
7:05 Paper Introduction
13:25 Experimental Setup
14:45 Model-wise Double Descent
17:43 Handwavy Double Descent Intuition
32:04 Epoch-wise Double Descent
34:30 Sample-wise Double Descent
37:24 Final Thoughts & Conclusion
38:48 Presentation Resources
#pytorch #computervision #doubledescent #machinelearning #deeplearning #supervisedlearning