Machine Translation - Summer Semester 2018 - Raphael Rubino

Multilingual Language Technology .... Vocabulary size is an issue for NMT (embedding matrix, softmax ... One solution: keep the n most frequent words.
2MB taille 0 téléchargements 273 vues
Machine Translation Summer Semester 2018

Multilingual Language Technology DFKI Saarbrücken

Outline

1

Encoder – Decoder with Attention

2

Performances and Recent Advances NMT Performances Recent NMT Advances

3

Attention Only

Outline

1

Encoder – Decoder with Attention

2

Performances and Recent Advances NMT Performances Recent NMT Advances

3

Attention Only

Encoder – Decoder

Figure: Luong et al.

Encoder – Decoder with Attention

Figure: Luong et al.

Encoder – Decoder with Attention

Figure: Luong et al.

I

˜ t) p(yt |y