The effectiveness of gradual learning

Ensemble Methods in Python

Román de las Heras

Data Scientist, Appodeal

Collective vs gradual learning

Collective Learning

  • Principle: wisdom of the crowd
  • Independent estimators
  • Learning the same task for the same goal
  • Parallel building

Gradual Learning

  • Principle: iterative learning
  • Dependent estimators
  • Learning different tasks for the same goal
  • Sequential building
Ensemble Methods in Python

Gradual learning

20190314_174424.jpg

Possible steps in gradual learning:

  1. First attempt (initial model)
  2. Feedback (model evaluation)
  3. Correct errors (subsequent model)
Ensemble Methods in Python

Fitting to noise

White noise

  • Uncorrelated errors
  • Unbiased errors and with constant variance

Improvement tolerance

  • If Performance difference < improvement threshold:
    • Stop training
Ensemble Methods in Python

It's your turn!

Ensemble Methods in Python

Preparing Video For Download...