Evaluating a Prompt Generation Strategy
A startup wants to quickly develop an AI feature for classifying customer support tickets. They have a detailed classification guide written by their support manager, but no AI specialists on the team. They decide to generate their initial set of prompts by feeding the classification guide into a large language model. Analyze the primary strength and the main potential weakness of this specific approach for their situation.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example of an Instruction for LLM-based Prompt Generation
A team is tasked with creating a system to summarize legal documents. To begin, they write a detailed, two-page description of the desired summary format, key information to include, and the target audience. They then input this description into a large language model with the instruction: 'Based on the provided document, generate a set of effective prompts for a summarization task.' When critiquing this team's strategy for creating an initial set of prompts, what is the most critical factor that will determine the success of their approach?
Troubleshooting Initial Prompt Generation
Evaluating a Prompt Generation Strategy