Without google's transformers, there is no GPT-ishs

Yes, remember back there in 2020/2021 when OpenAI created the gpt2? How about we really focus on what enable them to do that? google transformers. The modern generative AI industry was built on one of the most consequential papers in the history of software: Google’s 2017 paper, Attention Is All You Need . That paper introduced the Transformer architecture. And without that architecture, GPT-2 does not happen in the way we know it. Honestly, most of today’s AI industry does not happen in the sam