Pipeline Deployment to Production

Designing Forecasting Pipelines for Production

Rami Krispin

Senior Manager, Data Science and Engineering

Pre-deployment steps

Acquiring the data from the API

Designing Forecasting Pipelines for Production

Pre-deployment steps

Designing Forecasting Pipelines for Production

Pre-deployment steps

Designing Forecasting Pipelines for Production

Pre-deployment steps

Designing Forecasting Pipelines for Production

Deployment to production

Deployment process

$$

$$

  • Enables automation and resource scaling

$$

  • Makes work accessible to others 🌐
Designing Forecasting Pipelines for Production

Deployment to production

  • Live environment for real users and business operations 🏦

$$

Main components of production

Designing Forecasting Pipelines for Production

What could go wrong?

Data integrity

Designing Forecasting Pipelines for Production

What could go wrong?

Operational failures

Designing Forecasting Pipelines for Production

What could go wrong?

Infrastructure failures

Designing Forecasting Pipelines for Production

What could go wrong?

Model drift

Designing Forecasting Pipelines for Production

Monitoring and observability

Monitoring and observability

Designing Forecasting Pipelines for Production

Monitoring and observability

Monitoring and observability

Designing Forecasting Pipelines for Production

Monitoring and observability

$$

Observability vs monitoring

  • Handled by dedicated SRE or DevOps teams 🔧
Designing Forecasting Pipelines for Production

Let's practice!

Designing Forecasting Pipelines for Production

Preparing Video For Download...