Novelty of LLMs

Large Language Models (LLMs) Concepts

Vidhi Chugh

AI strategist and ethicist

Using text data

An image showing sentiment analysis, spam detection, and digital assistants

  • Unstructured data - messy and inconsistent
1 Freepik
Large Language Models (LLMs) Concepts

Machines do not understand language!

An image showing a computer's inability to interpret language as is

1 Freepik
Large Language Models (LLMs) Concepts

Need for NLP

 

An image showing NLP as the bridge between text and numbers which are then understood by the computer

1 Freepik
Large Language Models (LLMs) Concepts

Unique capabilities of LLMs

 

  • Linguistic subtleties
    • Irony
    • Humor
    • Pun
    • Sarcasm
    • Intonation
    • Intent

A person standing with a clipboard point at some generic text and a big question mark

1 Freepik
Large Language Models (LLMs) Concepts

What's your favorite book?

 

  • Natural response: "Oh, that's a tough one!"

 

  • Personal opinion: "My all-time favorite book is To Kill a Mockingbird by Harper Lee."

 

  • Supporting statement: "It's a powerful story about prejudice, justice, and the human experience."

 

  • Follow-up question: "Have you read it?"
Large Language Models (LLMs) Concepts

Linguistic subtleties

Sarcasm: "Oh great, another meeting."

Traditional language model:

  • Response: "What's the meeting about?"
    • Neutral
    • Does not pick up sarcasm

 

Large language model:

  • Response: "Sounds like you're looking forward to it!"
    • Playful
    • Engaging
    • Matches the sarcasm
Large Language Models (LLMs) Concepts

How do LLMs understand

 

  • Trained on vast amounts of data

  • Largeness of LLMs: parameters

  • Parameters represent the patterns and rules

  • More parameters -> complex patterns

  • Generates sophisticated and accurate responses

Large Language Models (LLMs) Concepts

Parameters

 

  • Small number of bricks -> limited structures

An image showing small number of blocks

 

  • Larger number of bricks -> complex and detailed structures

An image showing large number of bricks

Large Language Models (LLMs) Concepts

Emergence of new capabilities

 

  • Emergent abilities
    • only present in large-scale models

 

  • Scale:

    • The volume of training data
    • The number of model parameters

 

Graph showing sudden improvement in model performance when the scale of the model increases beyond a transition threshold

Large Language Models (LLMs) Concepts

Emergence of new capabilities

 

An image showing new capabilities like music, poetry, code generation, medical diagnosis and treatment groups

Large Language Models (LLMs) Concepts

Building blocks of LLMs

Building blocks of LLMs

Large Language Models (LLMs) Concepts

To recap

LLMs:

  • Overcome data's unstructured nature

 

  • Outperform traditional models

 

  • Understand linguistic subtleties

How?

  • LLMs' "largeness"
  • Extensive training data
  • Many parameters
  • Emergent abilities
Large Language Models (LLMs) Concepts

Let's practice!

Large Language Models (LLMs) Concepts

Preparing Video For Download...