トークン化とトランスフォーマー

ChatGPT中級

Alex Banks

Founder & Educator

トークン化

Illustration of a man looking at Transformer-type character, imagining the word "Tokens"

トークン化

Illustration of man with the likeness of the film character Terminator

エンコーディング

Illustration of man with the likeness of the film character Terminator

ベクトル化

Illustration of man with the likeness of the film character Terminator

デコーディング

Illustration of man with the likeness of the film character Terminator

自己注意（セルフアテンション）

Transormer-like robot character beside a weighing scale

自己注意（セルフアテンション）

Illustration of a cat sat on mat

トークン関係

The image features two colorful robots inside a large pink heart with smaller hearts surrounding it. The robot on the left is labeled "it" and the robot on the right is labeled "the cat." To the left of the heart, three text snippets are displayed vertically: "the cat," "sat," and "the cat," all in blue

文脈的理解

The image shows two colorful robots seated next to each other, with the robot on the right making a hand gesture as if speaking.

練習しましょう！

ChatGPT中級