Case context: A team is building a customer support classifier and first wants to use the result only for internal model debugging. Later, the same result may be included in a conference paper.

Question: Determine when the relabeling bias is acceptable and when it becomes a problem.

Sample answer: The bias is acceptable if the result is used only for internal debugging of the product. It becomes a problem once the team plans to present the result in a conference paper. It is also a problem if the team needs the result to serve as a fully unbiased estimate of test performance.

Key points:

• Internal debugging can tolerate the bias
• Conference-presentation use makes the bias problematic
• A requirement for an unbiased test-performance estimate also makes it problematic
• The judgment depends on how the result will be used

Rubric: The response must clearly distinguish internal development use from conference-paper use and classify the bias appropriately in each case. Mentioning the need for an unbiased performance estimate strengthens the answer.