A user asks a large language model to write a short biography of a famous female scientist. The model's response disproportionately focuses on her personal life and relationships, while similar requests for male scientists result in biographies centered on their professional accomplishments. Which source of model misalignment does this scenario best illustrate?

Analyzing Misalignment in a Customer Support LLM

Match each example of a large language model's output with the primary source of misalignment it demonstrates.