Opening the black box: making agents transparent

Building AI Agents with Haystack

Bilge Yücel

DevRel Engineer for Haystack at deepset

From LLMs to Agents

  • Can interact ✅   Cannot see what's happening inside ❌

user_healthcare_assistant.png

Building AI Agents with Haystack

Lack of visibility

  • No trace of tool calls

user_healthcare_assistant.png

Building AI Agents with Haystack

Lack of visibility

  • Hard to evaluate the correctness

user_healthcare_assistant.png

Building AI Agents with Haystack

Debugging

  • Wrong tool usage, wrong parameters, hallucination

Debugging.png

Building AI Agents with Haystack

Transparent agents

47.png

Building AI Agents with Haystack

Transparent agents

48.png

Building AI Agents with Haystack

Transparent agents

49.png

Building AI Agents with Haystack

Let's practice!

Building AI Agents with Haystack

Preparing Video For Download...