Abstract
In this talk, I will introduce the transformer, a ubiquitous building block of language models. I will also pontificate on why the architecture is the way it is, and what exactly it is trying to accomplish.
In this talk, I will introduce the transformer, a ubiquitous building block of language models. I will also pontificate on why the architecture is the way it is, and what exactly it is trying to accomplish.