Introduction to ensemble methods

Ensemble Methods in Python

Román de las Heras

Data Scientist, Appodeal

Choosing the best model

individual-models.png

Ensemble Methods in Python

Surveys

shutterstock_253684528.jpg

2018-10-29_22-54-45.png

Ensemble Methods in Python

Prerequisite knowledge

  • Supervised Learning with scikit-learn
  • Machine Learning with Tree-Based Models in Python
  • Linear Classifiers in Python

scikit-learn-logo-small.png

Ensemble Methods in Python

Technologies

scikit-learn-logo-small.png

  • scikit-learn
  • numpy
  • pandas
  • seaborn

mlxtend-logo.png

from sklearn.ensemble import MetaEstimator

# Base estimators
est1 = Model1()
est2 = Model2()
estN = ModelN()

# Meta estimator
est_combined = MetaEstimator(
   estimators=[est1, est2, ..., estN],
   # Additional parameters
)

# Train and test
est_combined.fit(X_train, y_train)

pred = est_combined.predict(X_test)
Ensemble Methods in Python

Learners, ensemble!

Ensemble Methods in Python

Preparing Video For Download...