Learn Before
Instruction Fine-Tuning as a Sample-Efficient Method
Instruction fine-tuning is considered a sample-efficient method because it effectively adapts a model's behavior using a significantly smaller set of training examples than what is required for pre-training.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.2 Generative Models - Foundations of Large Language Models
Related
Instruction Fine-Tuning as a Sample-Efficient Method
Application of Sample Efficiency in Advanced Learning Techniques
Two teams are developing a machine learning model to classify customer support tickets. Team A adapts a large, general-purpose model using 1,000 labeled tickets and achieves 92% accuracy. Team B trains a new model from scratch using 100,000 labeled tickets and also achieves 92% accuracy. Based on this information, which statement correctly analyzes the two approaches?
Choosing a Machine Learning Strategy with Limited Data
Evaluating a Development Strategy for an AI Chatbot
Learn After
A research lab has access to a large, general-purpose language model that was developed by training it on a vast and diverse collection of text from the internet. The lab's goal is to make this model specialized for generating safe and helpful medical advice. They have a limited budget, allowing them to create only a few thousand high-quality examples of medical questions paired with ideal, safe answers. Which of the following is the most effective and resource-conscious strategy for the lab to pursue?
AI Startup Strategy for Legal Document Summarization
Data Requirements in Model Training Phases