Question: What is GPT-3?
Answer: GPT-3 is the newest and most impressive of the [https://www.alignmentforum.org/tag/gpt GPT] (Generative Pretrained Transformer) series of large transformer-based language models created by OpenAI. It was announced in June 2020, and is 100 times larger than its predecessor GPT-2.(ref)[https://www.cambridge.org/core/journals/natural-language-engineering/article/gpt3-whats-it-good-for/0E05CFE68A7AC8BF794C8ECBE28AA990 GPT-3: What’s it good for?] - Cambridge University Press(/ref)
Gwern has several resources exploring GPT-3's abilities, limitations, and implications including:
- [https://www.gwern.net/Scaling-hypothesis The Scaling Hypothesis] - How simply increasing the amount of compute with current algorithms might create very powerful systems.
- [https://www.gwern.net/GPT-3-nonfiction GPT-3 Nonfiction]
- [https://www.gwern.net/GPT-3 GPT-3 Creative Fiction]
Vox has [https://www.vox.com/future-perfect/21355768/gpt-3-ai-openai-turing-test-language an article] which explains why GPT-3 is a big deal.