Training language models to follow instructions with human feedback¶
Ouyang, Wu, Jiang, Almeida, Wainwright, Mishkin, Zhang, et al. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Preference
- The ML case also makes the inference visible: the reward model is a learned approximation of the underlying preference relation, and the quality of the approximation depends on how the ordering itself is structured (transitivity helps; intransitive cycles do not).
This sourceScales the RLHF preference-learning pipeline to large language models (InstructGPT): collects pairwise human comparisons over model completions, fits a reward model, and optimizes the policy via PPO; canonical industrial application of preference learning at scale.
- The ML case also makes the inference visible: the reward model is a learned approximation of the underlying preference relation, and the quality of the approximation depends on how the ordering itself is structured (transitivity helps; intransitive cycles do not).
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:b10b86608b7b · see in the full table