Learn Before
In a methodology designed to bootstrap a large set of instructional data, the initial 'seed' tasks used to start the process are typically generated automatically by a language model.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Sampling in Self-Instruct
A research team is initiating a process to enhance a language model's ability to generate Python code from natural language descriptions. For their initial task pool, they gather 1,000 random Python code snippets from public repositories. Based on the principles of initializing this process, what is the primary weakness of their approach?
Evaluating Seed Task Suitability
Related
Sampling in Self-Instruct
A research team is initiating a process to enhance a language model's ability to generate Python code from natural language descriptions. For their initial task pool, they gather 1,000 random Python code snippets from public repositories. Based on the principles of initializing this process, what is the primary weakness of their approach?
Evaluating Seed Task Suitability