CI/CD/CT/CM in Fully Automated MLOps

Fully Automated MLOps

Arturo Opsetmoen Amador

Senior Consultant - Machine Learning

DevOps

$$

Figure representing the DevOps methodology: a combination of two cycles, Dev and Ops.

Fully Automated MLOps

CI/CD in DevOps

Figure of a typical CI/CD pipeline in DevOps.

Fully Automated MLOps

Fully automated MLOps

$$

Figure representing the MLOps methodology: a combination of three cycles, ML, Dev and Ops.

Fully Automated MLOps

Considerations about ML - Changing world

$$

Continuously changing world

A world with measurements spinning constantly.

$$

Continuous monitoring (CM)

A monitoring system continuously monitoring a changing world.

Fully Automated MLOps

Considerations about ML - Decaying performance

Continuously decaying models

A curve showing the fact that the performance of ML models is constantly decaying after being taken to production.

Continuous training (CT)

Figure representing a system that is under constant retraining.

Fully Automated MLOps

CI/CD/CT/CM in MLOps

$$

A CI/CD pipeline showing the different steps in a MLOps workflow.

Fully Automated MLOps

CI/CD/CT/CM in MLOps

$$

A CI/CD/CT pipeline showing the different steps in a MLOps workflow.

Fully Automated MLOps

CI/CD/CT/CM in MLOps

$$

A CI/CD/CT/CM pipeline showing the different steps in a typical MLOps workflow.

Fully Automated MLOps

Fully automated MLOps

$$

A figure with the legend: "Fully automated MLOps system".

Fully Automated MLOps

Fully automated MLOps - Automation first

$$

An arrow with the legend: "Automation first". The arrow points towards a box with the legend: "Fully automated MLOps system."

Fully Automated MLOps

Fully automated MLOps - Automated response pattern

A figure that is a continuation of the previous figure. In addition, there is a new arrow with the legend: "Automate - monitor - incident response". This new arrow is also pointing towards the box with the text: "Fully automated MLOps system".

Fully Automated MLOps

Fully automated MLOps - CI/CD/CT/CM

A figure that is a continuation of the previous figure. In addition, there is a new arrow with the legend: "CI/CD/CT/CM". This new arrow is also pointing towards the box with the text: "Fully automated MLOps system".

Fully Automated MLOps

Fully automated MLOps

$$

$$

Figure showing that to accomplish a fully automated MLOps system, it is necessary to have automation first, the automate-monitor-incident response pattern, and CI/CD/CT/CM.

Fully Automated MLOps

Let's practice!

Fully Automated MLOps

Preparing Video For Download...