LLMOps Concepts
Max Knobbout, PhD
Applied Scientist, Uber
Options:
Advantages/disadvantages like costs, scalability, efficiency and flexibility
Scaling strategies:
Horizontal for traffic, vertical for reliability and speed
LLMOps Concepts