Example of Persistent General-Purpose Behavior: Math Fine-Tuning

Using Diverse Data to Steer LLM Specialization

A development team adapts a large, pre-existing language model to function as a specialized chatbot for a legal information service. The adaptation process uses a dataset consisting solely of legal questions and their corresponding factual answers. After deployment, the team finds that the chatbot accurately answers legal queries but also responds correctly when users ask it to write poems or summarize news articles. Which statement provides the most accurate explanation for the chatbot's behavior?

Diagnosing Unexpected Model Behavior

Explaining Unintended Model Capabilities

Multi-Task Capability through Diverse Fine-Tuning Datasets

Modern Focus of Instruction Fine-Tuning Datasets

Using Diverse Data to Steer LLM Specialization

Examples of Instruction-Following Tasks in SFT Datasets

A development team has fine-tuned a large language model to be a helpful assistant. They observe that the model excels at summarizing technical documents and answering direct factual questions, which were the primary tasks in its fine-tuning dataset. However, when users ask it to perform more creative tasks like writing a short poem or brainstorming marketing slogans, the model's performance is poor and generic. Which of the following strategies would be the most effective next step to improve the model's ability to handle this wider range of user requests?

Using Varied Instructions for a Single Task to Enhance Data Diversity

Improving a Customer Service Chatbot's Robustness

Characteristics and Limitations of Early Instruction Fine-Tuning Datasets

Evaluating a Fine-Tuning Strategy for LLMs

Example of a Recipe Generation Task for LLMs

Example of a Creative Writing Task for LLMs

Example of a Math Word Problem Task for LLMs