Cloud providers
Introduction to Data Engineering
Vincent Vankrunkelsven
Data Engineer @ DataCamp
Data processing in the cloud
Clusters of machines required
Problem: self-host data-center
- Cover electrical and maintenance costs
- Peaks vs. quiet moments: hard to optimize
Solution: use the cloud
Data storage in the cloud
Reliability is required
Problem: self-host data-center
- Disaster will strike
- Need different geographical locations
Solution: use the cloud
The big three: AWS, Azure and Google
32% market share in 2018
17% market share in 2018
10% market share in 2018
