Improving performance

Capire il Machine Learning

Hadrien Lacroix

Content Developer at DataCamp

Machine learning workflow

Capire il Machine Learning

Several options

  • Dimensionality reduction
  • Hyperparameter tuning
  • Ensemble methods
Capire il Machine Learning

Dimensionality reduction

Reducing the number of features

zen woman after sorting and throwing away

Capire il Machine Learning

Dimensionality reduction: example

Irrelevance: some features don't carry useful information

Machine learning model

Capire il Machine Learning

Dimensionality reduction: example

Correlation: some features carry similar information

  • Keep only one feature
    • e.g. height and shoe size --> height
  • Collapse multiple features into one underlying feature
    • e.g. height and weight --> Body Mass Index
Capire il Machine Learning

Hyperparameter tuning

music mixing console

Capire il Machine Learning

Hyperparameter tuning

taylor swift

Capire il Machine Learning

Hyperparameter tuning

kendrick-lamar

Capire il Machine Learning

Hyperparameter tuning

alice cooper

Capire il Machine Learning

Hyperparameter tuning

music mixing console

Capire il Machine Learning

Hyperparameter tuning: example

SVM algorithm hyperparameters:

  • kernel: "linear" --> "poly"
  • C
  • degree
  • gamma
  • shrinking
  • coef0
  • tol
  • ...

Capire il Machine Learning

Ensemble methods

ensemble methods

Capire il Machine Learning

Ensemble methods: classification

ensemble methods classification

Capire il Machine Learning

Ensemble methods: regression

ensemble methods regression

Capire il Machine Learning

Let's practice!

Capire il Machine Learning

Preparing Video For Download...