EY
Eugene Yan
@eugeneyan.bsky.social
Building ml, recsys, & llm systems @ Amazon.
Writing @ eugeneyan.com & applyingml.com.
325 followers166 following53 posts
GPT2: Unsupervised pre-training is all you need?! https://openai.com/research/better-language-models
GPT3: Unsupervised pre-training + a few* examples is all you need. *Up to 5 (Conversational QA) - 50 examples (Winogrande, PhysicalQA, TriviaQA) https://arxiv.org/abs/2005.14165
EY
Eugene Yan
@eugeneyan.bsky.social
Building ml, recsys, & llm systems @ Amazon.
Writing @ eugeneyan.com & applyingml.com.
325 followers166 following53 posts