Flow Card
InstructGPT vs GPT-3: The battle for better language models
Computer ScienceMachine Learning
About this opportunity
OpenAI's new InstructGPT models are making waves in the world of language models, being much better at following user intentions and generating less toxic outputs than the popular GPT-3 models. These InstructGPT models are now the default language models on the OpenAI API, powered by reinforcement learning from human feedback (RLHF).
By having human annotators provide demonstrations of desired model behavior and ranking several outputs from the models, the resulting InstructGPT models are safer, more helpful, and more aligned with their users. This breakthrough shows that fine-tuning language models with humans in the loop is a powerful tool for improving their safety and reliability, without compromising on capabilities.
Guided action
Is this worth acting on?
Ask Flow for a fast read on fit, details, trust, and next steps. If you want to apply or prepare, move into FlowApply and add evidence before drafting.
Prepare application
Understand details
Check fit
Verify source
Ask for help
The source/contact link is carried into Ask Flow or FlowApply so the session starts with context.