Deployment progression and testing

MLOps Deployment and Life Cycling

Nemanja Radojkovic

Senior Machine Learning Engineer

Not so fast!

 

 

 

 

• Don't rush to deploy without thorough testing!

Agenda

TEST TYPES

• Unit tests
• Integration tests
• Smoke tests
• Load tests
• Acceptance tests

DEV, DEPLOY, TEST ENVIRONMENTS

• Development
• Test
• Staging
• Production

 

OUT OF SCOPE: Predictive model performance

IN SCOPE: Testing the overall ML app

Unit testing

Checking if independent code units behave as expected

EXAMPLE

Function to test:

def add_two_numbers(x, y):
    return x + y

Unit test:

add_two_numbers(1, 1) == 2
add_two_numbers(2, 3) == 5

A single weak link breaks the system

We must be careful what we introduce in production.

 

 

 

The Challenger shuttle disaster in 1986 was caused by a failed rubber sealing ring

Let's practice!

MLOps Deployment and Life Cycling