Picking the best AI tool for the job
AI-Assisted Coding for Developers
Francesca Donadoni
AI Curriculum Manager, DataCamp
Benchmarks
Benchmarks
1 https://artificialanalysis.ai/models
Model comparison
$$
"Generate Python unit tests using pytest for the following function. Include cases for empty input, SQL keywords in the input, and special characters. Assume a mock database connection:
<paste function implementation>"
Model comparison
Tokenization
- LLMs work on numerical data (tokens)
Cost
Cost
Reasoning models
Output quality
Output quality
Output quality
