Learn Before
Essay

Designing a Challenging Multiple-Choice Question for a Language Model

Imagine you are designing a test to evaluate a new language model's ability to handle subtle linguistic nuances and common-sense reasoning. Your task is to create a single, original multiple-choice question that is easy for a human to answer but is likely to be challenging for a language model. Your response must include:

  1. The question itself.
  2. Four answer choices (one correct, three incorrect 'distractors').
  3. A brief explanation of why the specific distractors you created are likely to mislead a language model, even if it has been trained on a vast amount of text.

0

1

Updated 2025-10-06

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Creation in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science