Improving performance

Understanding Machine Learning

Hadrien Lacroix

Content Developer at DataCamp

Machine learning workflow

Understanding Machine Learning

Several options

  • Dimensionality reduction
  • Hyperparameter tuning
  • Ensemble methods
Understanding Machine Learning

Dimensionality reduction

Reducing the number of features

zen woman after sorting and throwing away

Understanding Machine Learning

Dimensionality reduction: example

Irrelevance: some features don't carry useful information

Machine learning model

Understanding Machine Learning

Dimensionality reduction: example

Correlation: some features carry similar information

  • Keep only one feature
    • e.g. height and shoe size --> height
  • Collapse multiple features into one underlying feature
    • e.g. height and weight --> Body Mass Index
Understanding Machine Learning

Hyperparameter tuning

music mixing console

Understanding Machine Learning

Hyperparameter tuning

taylor swift

Understanding Machine Learning

Hyperparameter tuning

kendrick-lamar

Understanding Machine Learning

Hyperparameter tuning

alice cooper

Understanding Machine Learning

Hyperparameter tuning

music mixing console

Understanding Machine Learning

Hyperparameter tuning: example

SVM algorithm hyperparameters:

  • kernel: "linear" --> "poly"
  • C
  • degree
  • gamma
  • shrinking
  • coef0
  • tol
  • ...

Understanding Machine Learning

Ensemble methods

ensemble methods

Understanding Machine Learning

Ensemble methods: classification

ensemble methods classification

Understanding Machine Learning

Ensemble methods: regression

ensemble methods regression

Understanding Machine Learning

Let's practice!

Understanding Machine Learning

Preparing Video For Download...