GPTモデルとLLMの学習

ChatGPT中級

Alex Banks

Founder & Educator

GPTの誕生

The image features a surprised man on the left, looking at three purple bars of increasing size labeled GPT-1, GPT-2, and GPT-3 from left to right, representing the growth in size of each version

GPTの誕生

An illustration shows a man standing looking toward an oval shape, representing a neuron

GPTの分解

An illustration shows a confused man with a question mark above his head. To his right, the text 'Generative Pre-trained Transformer' is displayed, with an arrow pointing to 'GPT' in bold and underlined

An illustration shows a man writing in a notebook with a pencil. To his left, the word 'Generative' is displayed

Illustration of a man running with books and electronic devices trailing behind him, with the word 'Pre-trained' to the right

Illustration of a man transforming from one state to another, with the word 'Transformer' above them

Illustration of a man sitting with a laptop, next to the ChatGPT logo

LLMに学習させるには？

Illustration of a woman reading a book standing next to a large robot, both looking at the book

ステップ1 - 事前学習

大量の低品質インターネットデータ Illustration of a woman holding a clipboard, with a chart and a table detailing the pre-training process and data of GPT models

ステップ 2 - ファインチューニング

少量の高品質会話データ Illustration of a woman standing next to a robot, and some example conversation data

ステップ 3 - RLHF

RLHF （人間のフィードバックによる強化学習）

Illustration of two women holding question-mark cards, with thought bubbles saying 'Option A' and 'Option B' above their heads

比較ラベルの作成におけるAIの役割

Illustration of a woman giving a thumbs up next to a robot, with three haikus about AI displayed on screens. The woman and robot each have thought bubbles saying 'This one!

比較ラベルの作成におけるAIの役割

ラベリングは人間と機械の共同作業

Illustration showing a person icon and a robot icon connected by a slider, with a woman and a large robot standing next to them harmoniously

練習しましょう！

ChatGPT中級