In June 2017 a team at Google Brain quietly published the Transformer. Eight years later, every serious language model still descends from it.
Home