Learn Before
  • Bayes error rate

  • Human Level Performance

If your goal is to have “human-level performance” be a proxy (or estimate) for Bayes error, how would you define “human-level performance”?

You ask a few people to label the dataset to find out what is human-level performance. You find the following levels of accuracy:

  • Expert #1: 0.3% error
  • Expert #2: 0.5% error
  • Normal Person #1 (not an expert): 1.0% error
  • Normal Person #2 (not an expert): 1.2% error

0

2

4 years ago

Tags

Data Science

Related
  • Bayes Error Rate for (Naive) Bayes Classifier

  • Human Level Performance

  • Avoidable bias

  • If your goal is to have “human-level performance” be a proxy (or estimate) for Bayes error, how would you define “human-level performance”?

  • Human Level Proxy for Bayes Error

  • Which of the following statements about algorithmic performance do you agree with?

  • Bayes Calssifier and Bayes Error Rate

  • Human Level Proxy for Bayes Error

  • If your goal is to have “human-level performance” be a proxy (or estimate) for Bayes error, how would you define “human-level performance”?

  • Human Level Performance: Based on the evidence below, which two of the following four options seem the most promising to try?

  • Which of the following statements about algorithmic performance do you agree with?