Evaluating a Prompt Template for Data Generation
A developer is using a large language model to generate new training data. The goal is to create new samples, each consisting of an instruction, a user input, and an output. The developer provides the model with several high-quality examples and then uses the following prompt template to request a new one:
'Here are some examples. Make a new one.'
Identify two weaknesses of this prompt template and explain how you would improve it to generate better results.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A research team is using an automated process to generate new training data. The process involves showing a language model a few high-quality examples, where each example consists of an 'instruction', a user 'input', and a corresponding 'output'. The goal is for the model to then create a completely new, well-formed example that follows the same three-part structure. Which of the following prompts, given to the model after the examples, would be most effective and precise for this task?
Troubleshooting an Automated Data Generation Process
Evaluating a Prompt Template for Data Generation