How MLOps teams successfully operate

MLOps for Business

Arne Jonas Warnke

Head of Emerging Curriculum

Limited impact of machine learning (the past)

Earlier, firms used an experimental approach to machine learning.

Issues were, among others,

  • Silos
  • Models often didn't make it into production
  • Long development time
  • No or only minor automation
  • Lack of reproducibility

A black-white picture of a single person in front of a 1980 computer

MLOps for Business

How MLOps teams successfully operate

$$

In this video

  • Less focus on technologies
  • Look at successful DevOps practices
MLOps for Business

Reminder DevOps

DevOps aims

  • To increase collaboration between developers and operators

Development is about

  • Enhancing user experience
  • New business requirements

Operations seeks

  • Stability and maintainability

DevOps

1 Kim et al. (2021). The DevOps handbook: How to create world-class agility, reliability, & security in technology organizations. IT Revolution.
MLOps for Business

Common DevOps practices

  • Continuous delivery
    • Frequent, small, and reliable code releases
    • E.g. constantly adding small features (or code changes)
  • Automation of testing and releasing
  • Monitoring, easy "roll-backs"
  • Continuous integration

$$ A software release blue print

1 Leite et al. (2019). A survey of DevOps concepts and challenges. ACM Computing Surveys (CSUR), 52(6), 1-35.
MLOps for Business

Handling failures

DevOps circle $$ A blue screen

  • Feedback loops
    • Automated tests
    • Identify failures early
  • If something goes wrong
    • Root cause analyses
    • Blameless post-mortems
    • Learning, knowledge-sharing improving
MLOps for Business

People and teams

MLOps / DevOps is all about collaboration

  • Companies design teams differently

$$

Common features are

  • Autonomy
  • Joined incentives
  • Feedback loops and learning
  • Trust
  • Rewarding risk-taking

$$ People collaborating

MLOps for Business

Experimentation

Aim for high-quality through experimentation

  • A/B testing (randomized experiments)
  • Injecting deliberate failures

$$ A laboratory test

MLOps for Business

Let's practice!

MLOps for Business

Preparing Video For Download...