Gratulujeme!

Transformer Models with PyTorch

James Chapman

Curriculum Manager, DataCamp

Kapitola 1

model = nn.Transformer(
    d_model=1536,
    nhead=8,
    num_encoder_layers=6,
    num_decoder_layers=6
)
class InputEmbeddings(nn.Module): ...
class PositionalEncoding(nn.Module): ...
class MultiHeadAttention(nn.Module): ...

Architektura transformeru z akademického článku Attention Is All You Need.

Transformer Models with PyTorch

Transformer pouze s enkodérem

Architektura transformeru pouze s enkodérem

Transformer pouze s dekodérem

Architektura transformeru pouze s dekodérem

Transformer Models with PyTorch

Kapitola 2 – Transformer enkodér-dekodér

Architektura původního transformeru

Transformer Models with PyTorch

Co dál?

Transformer Models with PyTorch

Pojďme procvičovat!

Transformer Models with PyTorch

Preparing Video For Download...