Case Study

Flaw in a Synthesis Prompt

A developer is building a system to determine if a long technical manual contains information about 'safety protocols'. The system first breaks the manual into 100 segments and uses a separate process to generate a 'relevancy score' for each segment. To get the final answer, the developer uses the following follow-up prompt:

'I have provided the relevancy scores for 100 segments of a technical manual regarding 'safety protocols'. Now, please re-read the original manual and, based on your reading, provide a final yes/no answer as to whether it discusses safety protocols.'

Analyze the developer's follow-up prompt. What is the primary design flaw in this prompt, considering the goal is to efficiently synthesize a conclusion from the pre-analyzed segments?

0

1

Updated 2025-10-04

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science