Model training
Generative AI Concepts
Daniel Tedesco
Data Lead, Google
Pick your mode of train-sportation
Hardware
Time
Dataset size
Model complexity
Rounds of training
Cost
Graduate to advanced techniques
Foundation generative AI model is a first step
Advanced techniques specialize them for specific contexts
Key advanced techniques:
Transfer learning and fine-tuning
RLHF
Custom embeddings
From cats to lions
Transfer learning transfers knowledge from one task to another
Fine-tuning is a type of transfer learning for a small dataset
1
Creative Commons Attribution-Share Alike 4.0, Bing image generator
Where does your feedback go?
1
Google Bard, 2023
Thumbs up for better responses
1
Google Bard, 2023
Embeddings as fingerprints
Similar to recognizing a fingerprint
Unique representations of data entities
Capture meaning, context, and relationships in compact form
1
Wikimedia commons
Embedding Dan
1
Daniel Tedesco, 2023
Embedded Dan
1
Daniel Tedesco portraits from vana.com
Let's practice!
Generative AI Concepts
Preparing Video For Download...