Lilian Weng 3/14/2019

Are Deep Neural Networks Dramatically Overfitted?

Read Original

This technical article investigates the apparent contradiction of deep neural networks (DNNs) generalizing effectively despite their high parameter counts and capacity for perfect training accuracy. It examines classic concepts like Occam's Razor and the Minimum Description Length principle, and references modern research like the Lottery Ticket Hypothesis to understand the generalization capabilities of DNNs.

Are Deep Neural Networks Dramatically Overfitted?

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser