Free · Tech & Psychology
You are not bad at reading research papers.
They are written to survive peer review, not to be read by you. So pick a paper, tell it who you are, and read it at your level. Every paper gets an honest does it hold up?
The shelf
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, et al. · 2017
Drop the step-by-step reading of older models and let every word attend to every other word at once. That one change, the Transformer, became the foundation of modern language models.
Read it your way →TechConstitutional AI: Harmlessness from AI Feedback
Yuntao Bai, Saurav Kadavath, Sandipan Kundu, et al. · 2022
Teach an AI to be harmless by giving it a short written set of principles (a constitution) and having it critique and revise its own answers, instead of relying on humans to label every harmful response.
Read it your way →TechLanguage Models are Few-Shot Learners (GPT-3)
Tom B. Brown, Benjamin Mann, Nick Ryder, et al. · 2020
Make a language model enormous (175 billion parameters) and it starts doing new tasks from just a few examples in the prompt, no retraining. This paper is why prompting became the way we use AI.
Read it your way →