In a text classification system that uses a large pre-trained model to generate a single vector representation for an input text, the final component that maps this vector to a class label must be a multi-layer neural network to maintain high performance.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Optimizing a Text Classification Pipeline
A team is developing a text classification system to sort user feedback into 30 categories. They use a large pre-trained model to convert each piece of feedback into a single, information-rich numerical vector. For the final step of mapping this vector to one of the 30 categories, they are considering different options. Given that the team is working with a limited computational budget and a short project timeline, which of the following choices for the final classification layer is most justifiable?
In a text classification system that uses a large pre-trained model to generate a single vector representation for an input text, the final component that maps this vector to a class label must be a multi-layer neural network to maintain high performance.