Encoder-decoder-architectuur

Machine Translation met Keras

Thushan Ganegedara

Data Scientist and Author

Encoder-decoder-model

Machinevertalingsmodel

Machine Translation met Keras

Encoder

Encoder

Machine Translation met Keras

Encoder en decoder

Encoder en decoder

Machine Translation met Keras

Analogie: encoder-decoder-architectuur

Encoder-analogie

Decoder-analogie

Machine Translation met Keras

Zinnen omkeren - encoder-decoder-model

Encoder-decoder tekst omkeren

Machine Translation met Keras

De encoder schrijven

def words2onehot(word_list, word2index):
  word_ids = [word2index[w] for w in word_list]
  onehot = to_categorical(word_ids, 3)
  return onehot
def encoder(onehot):
  word_ids = np.argmax(onehot, axis=1)
  return word_ids
Machine Translation met Keras

De encoder schrijven

onehot = words2onehot(["I", "like", "cats"], word2index)
context = encoder(onehot)
print(context)
[0, 1, 2]
Machine Translation met Keras

De decoder schrijven

  • Decoder: woord-ID's → ID's omkeren → one-hotvectoren
def decoder(context_vector):
  word_ids_rev = context_vector[::-1]
  onehot_rev = to_categorical(word_ids_rev, 3)
  return onehot_rev
  • Hulpfunctie: zet one-hotvectoren om naar leesbare woorden
def onehot2words(onehot, index2word):
  ids = np.argmax(onehot, axis=1)
  return [index2word[id] for id in ids]
Machine Translation met Keras

De decoder schrijven

onehot_rev = decoder(context)
reversed_words = onehot2words(onehot_rev, index2word)

print(reversed_words)
['cats', 'like', 'I']
Machine Translation met Keras

Laten we oefenen!

Machine Translation met Keras

Preparing Video For Download...