Selecting a Strategy for Complex Text Classification
A data science team at a large online retailer needs to automatically categorize customer support emails into one of 120 specific and nuanced categories (e.g., 'late delivery due to weather', 'damaged item from shipping', 'incorrect product variant shipped'). The team has access to a historical dataset of 2 million emails, each already correctly labeled by human agents. A junior team member suggests using a general-purpose, off-the-shelf large language model by providing it with a prompt that lists all 120 categories and asks it to choose the most appropriate one for each new email. Analyze the junior member's proposed solution. Is this the most effective and robust approach given the scale and nature of the problem? Justify your reasoning and propose a more suitable alternative if you believe one exists.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Selecting a Strategy for Complex Text Classification
A company is developing an automated system to classify customer support emails into 30 highly specific and nuanced categories. They have a high-quality, labeled dataset of 100,000 examples. Which statement best justifies why fine-tuning a model would be a more effective approach than using standard prompting for this task?
Evaluating Model Architectures for a Nuanced Classification Task