Life-cycling stages

Deployment e ciclo di vita in MLOps

Nemanja Radojkovic

Senior Machine Learning Engineer

Machine Learning life cycles

 

  1. ML project life cycle
  2. ML application life cycle
  3. ML model life cycle
Deployment e ciclo di vita in MLOps

ML project bare

Deployment e ciclo di vita in MLOps

ML project with outcomes

Deployment e ciclo di vita in MLOps

pure estimator

Deployment e ciclo di vita in MLOps

ml application

Deployment e ciclo di vita in MLOps

business rules

Deployment e ciclo di vita in MLOps

database

Deployment e ciclo di vita in MLOps

graphical user interface

Deployment e ciclo di vita in MLOps

API

Deployment e ciclo di vita in MLOps

model and app together

Deployment e ciclo di vita in MLOps

locked in model

Deployment e ciclo di vita in MLOps

separation I

Deployment e ciclo di vita in MLOps

fly away

Deployment e ciclo di vita in MLOps

separate timelines

Deployment e ciclo di vita in MLOps

app life cycle

Deployment e ciclo di vita in MLOps

model life cycle

Deployment e ciclo di vita in MLOps

we are here

Deployment e ciclo di vita in MLOps

A model is...

NOT something abstract and/or theoretical

A model IS

  • a concrete, trained model
  • ready to be put in use
Deployment e ciclo di vita in MLOps

Deployment

 

  • Model object + deployment resources = model deployment package
  • Putting our model in use = deployment

 

deployment race start

Deployment e ciclo di vita in MLOps

Model monitoring

 

  • Is the model server running?
  • Are the model inputs and outputs as expected?
  • Also known as post-deployment monitoring

 

model monitoring

Deployment e ciclo di vita in MLOps

Decommissioning

 

power off

 

Possible reasons

  • Better model discovered
  • More informative features created
  • Modeled process changed, invalidating the existing model

 

=> Out with the old, in with the new

Deployment e ciclo di vita in MLOps

Model archiving

  • Important in regulated industries.

    Why did your credit-risk model green-light this loan back in 2020?

 

  • Reproducibility: ability to recreate, re-load, and use an old version of a model
    • Not a trivial requirement

 

model archive

Deployment e ciclo di vita in MLOps

Let's practice!

Deployment e ciclo di vita in MLOps

Preparing Video For Download...