Levels of MLOps maturity

MLOps Concepts

Folkert Stijnman

ML Engineer

MLOps maturity

  • Level of automation, collaboration, and monitoring within MLOps processes
  • Higher level is not necessarily better
  • Focus on development and deployment phase
MLOps Concepts

Levels of MLOps maturity

Levels of mlops maturity

MLOps Concepts

Level 1: Manual processes

Level 1 maturity

 

  • Manual process for development
  • Manual process for deployment
  • No collaboration between ML and operations

  • Teams work in isolation

  • No tracking of development

  • No monitoring after deployment
MLOps Concepts

Level 2: Automated development

Level 2 maturity

 

  • Automated development pipeline (Continuous integration)

  • Manual process for deployment

  • After development teams will collaborate to deploy model

  • Tracking of ML experiments and features

  • Little monitoring after deployment
MLOps Concepts

Level 3: Automated development and deployment

Level 3 maturity

 

  • Automated development pipeline (CI)

  • Automated deployment pipeline (CD)

  • Close collaboration between teams

  • Monitoring of development and deployment

  • Potentially automatically triggering retraining
MLOps Concepts

Let's practice!

MLOps Concepts

Preparing Video For Download...