Fine-tuning datasets used to teach Large Language Models instruction-following abilities contain a wide variety of tasks paired with their correct outputs. Two examples of such instruction-response pairs include:

1. Mathematical Reasoning: An arithmetic instruction might ask, "If you buy 5 apples and each apple costs $1.20, how much do you spend in total?" with the expected response being "$6.00".
2. Code Generation: A programming instruction might ask, "Write a Python program to calculate the sum of squares of the following numbers. 1, 2, 10, -9, 78," paired with a corresponding code response that performs the calculation:

   numbers = [1, 2, 10, -9, 78]
   sum_of_squares = sum(x**2 for x in numbers)
   print(sum_of_squares)