Large Language Models (LLMs) Concepts
Vidhi Chugh
AI strategist and ethicist
Trained using generative pre-training
Input
The quick brown
The quick brown fox
The quick brown fox jumps
The quick brown fox jumps over
The quick brown fox jumps over the
The quick brown fox jumps over the lazy
The quick brown fox jumps over the lazy dog.
Output
fox
jumps
over
the
lazy
dog
Hides a selective word
Trained model predicts the masked word
Original Text: "The quick brown fox jumps over the lazy dog."
Masked Text: "The quick [MASK] fox jumps over the lazy dog."
Objective: predict the missing word
Based on learnings from training data
Large Language Models (LLMs) Concepts