Learn Before
Crafting an SFT Data Point
Imagine you are fine-tuning a language model to become a helpful travel agent for a specific city, Paris. Your goal is to teach it to answer questions about famous landmarks. Create a single, high-quality data point (an instruction and its corresponding ideal output) that could be used in the dataset for this purpose.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Creation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A machine learning engineer is preparing data to teach a pre-trained language model how to follow specific user commands. Below is a single example entry from the dataset they are creating:
{ "instruction": "Summarize the following text into a single sentence: 'The sun is a star at the center of the Solar System. It is a nearly perfect sphere of hot plasma, with internal convective motion that generates a magnetic field via a dynamo process. It is by far the most important source of eDataset Strategy for Model Specialization
Crafting an SFT Data Point