Reinforcement Learning from Human Feedback (RLHF)

A development team is working on an AI assistant. After its initial training, they find that while the assistant's answers are factually accurate, they are often perceived as blunt or unhelpful. To address this, the team decides to use a process where human evaluators are shown a user's prompt followed by two or more different responses generated by the assistant. Which of the following tasks, given to the human evaluators, would be most effective for refining the model's helpfulness and tone?

Addressing Post-Tuning Model Flaws

An AI development team wants to improve a pre-trained model's alignment by making its responses more helpful and less likely to be harmful. Arrange the core steps of the process for incorporating human evaluations into this refinement stage.