Thinking about model capacity

Introduction to Deep Learning in Python

Dan Becker

Data Scientist and contributor to Keras and TensorFlow libraries

Overfitting

ch4_3.003.png

Introduction to Deep Learning in Python

Workflow for optimizing model capacity

  • Start with a small network

  • Gradually increase capacity

  • Keep increasing capacity until validation score is no longer improving

Introduction to Deep Learning in Python

Sequential experiments

ch4_3.009.png

Introduction to Deep Learning in Python

Sequential experiments

ch4_3.010.png

Introduction to Deep Learning in Python

Sequential experiments

ch4_3.011.png

Introduction to Deep Learning in Python

Sequential experiments

ch4_3.012.png

Introduction to Deep Learning in Python

Sequential experiments

ch4_3.013.png

Introduction to Deep Learning in Python

Let's practice!

Introduction to Deep Learning in Python

Preparing Video For Download...