Levels of MLOps maturity

Concetti MLOps

Folkert Stijnman

ML Engineer

MLOps maturity

  • Level of automation, collaboration, and monitoring within MLOps processes
  • Higher level is not necessarily better
  • Focus on development and deployment phase
Concetti MLOps

Levels of MLOps maturity

Levels of mlops maturity

Concetti MLOps

Level 1: Manual processes

Level 1 maturity

 

  • Manual process for development
  • Manual process for deployment
  • No collaboration between ML and operations

  • Teams work in isolation

  • No tracking of development

  • No monitoring after deployment
Concetti MLOps

Level 2: Automated development

Level 2 maturity

 

  • Automated development pipeline (Continuous integration)

  • Manual process for deployment

  • After development teams will collaborate to deploy model

  • Tracking of ML experiments and features

  • Little monitoring after deployment
Concetti MLOps

Level 3: Automated development and deployment

Level 3 maturity

 

  • Automated development pipeline (CI)

  • Automated deployment pipeline (CD)

  • Close collaboration between teams

  • Monitoring of development and deployment

  • Potentially automatically triggering retraining
Concetti MLOps

Let's practice!

Concetti MLOps

Preparing Video For Download...