Learn Before
Examples of Instruction Fine-Tuning Samples
An instruction fine-tuning sample pairs an input with a desired output, and the input can be structured in various formats to train the same task. For example, to teach a model to evaluate grammar, one sample's input might use a direct command like "Read the following sentence, and answer whether it is grammatically correct" followed by the sentence. Another sample's input might present the same sentence as a multiple-choice question, asking "Does this sentence make sense grammatically?" and listing explicit options like "Yes" and "No". In both formats, the corresponding desired output is simply the correct answer, "Yes".
0
1
Tags
Foundations of Large Language Models
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Components of the Input in an Instruction Fine-Tuning Sample
A machine learning engineer is preparing a dataset to train a language model to summarize articles. Below is a single, complete data point from this dataset, formatted as a continuous block of text. Based on the typical structure for such training data, which option correctly identifies the two primary components of this sample?
Data Sample:
System: You are a helpful assistant that summarizes texts.
Instruction: Summarize the following article.
Article: [A long article about the discovery of a new planet...]
Summary: Scientists have discovered a new exoplanet, named Kepler-186f, which orbits within the habitable zone of its star, suggesting the potential for liquid water.
A developer is creating a single data sample to fine-tune a chatbot. Arrange the following components into the correct sequence to form a complete and valid training example.
Constructing a Fine-Tuning Sample
Examples of Instruction Fine-Tuning Samples