RAG with text and images

RAG end-to-end con Weaviate

JP Hwang

Senior Developer Educator, Weaviate

What about the images?

 

  • Images after docling: <!-- image -->
  • Image context is lost

 

  • New approach: treat the entire document as an image

hai_ai-index-report-2025_chapter2_excerpts_8_of_8.jpg

RAG end-to-end con Weaviate

RAG with images

image_rag.png

RAG end-to-end con Weaviate

Multi-modal embedding models

cat_in_hat.png

RAG end-to-end con Weaviate

Encoding images

encoding_images1.png

RAG end-to-end con Weaviate

Encoding images

encoding_images2.png

RAG end-to-end con Weaviate

Encoding images

encoding_images.png

RAG end-to-end con Weaviate

Augmenting and generating with images

 

multi_modal_prompt.png

RAG end-to-end con Weaviate

Let's practice!

RAG end-to-end con Weaviate

Preparing Video For Download...