OpenAI's 175-billion-parameter GPT-3 paper made the case, in May 2020, that a big enough Transformer can learn new tasks from a handful of examples in its prompt.
Home