Life-cycling stages

MLOps Deployment and Life Cycling

Nemanja Radojkovic

Senior Machine Learning Engineer

Machine Learning life cycles

 

  1. ML project life cycle
  2. ML application life cycle
  3. ML model life cycle
MLOps Deployment and Life Cycling

ML project bare

MLOps Deployment and Life Cycling

ML project with outcomes

MLOps Deployment and Life Cycling

pure estimator

MLOps Deployment and Life Cycling

ml application

MLOps Deployment and Life Cycling

business rules

MLOps Deployment and Life Cycling

database

MLOps Deployment and Life Cycling

graphical user interface

MLOps Deployment and Life Cycling

API

MLOps Deployment and Life Cycling

model and app together

MLOps Deployment and Life Cycling

locked in model

MLOps Deployment and Life Cycling

separation I

MLOps Deployment and Life Cycling

fly away

MLOps Deployment and Life Cycling

separate timelines

MLOps Deployment and Life Cycling

app life cycle

MLOps Deployment and Life Cycling

model life cycle

MLOps Deployment and Life Cycling

we are here

MLOps Deployment and Life Cycling

A model is...

NOT something abstract and/or theoretical

A model IS

  • a concrete, trained model
  • ready to be put in use
MLOps Deployment and Life Cycling

Deployment

 

  • Model object + deployment resources = model deployment package
  • Putting our model in use = deployment

 

deployment race start

MLOps Deployment and Life Cycling

Model monitoring

 

  • Is the model server running?
  • Are the model inputs and outputs as expected?
  • Also known as post-deployment monitoring

 

model monitoring

MLOps Deployment and Life Cycling

Decommissioning

 

power off

 

Possible reasons

  • Better model discovered
  • More informative features created
  • Modeled process changed, invalidating the existing model

 

=> Out with the old, in with the new

MLOps Deployment and Life Cycling

Model archiving

  • Important in regulated industries.

    Why did your credit-risk model green-light this loan back in 2020?

 

  • Reproducibility: ability to recreate, re-load, and use an old version of a model
    • Not a trivial requirement

 

model archive

MLOps Deployment and Life Cycling

Let's practice!

MLOps Deployment and Life Cycling

Preparing Video For Download...