Short Answer

Optimizing LLM Inference for Different Tasks

A company is developing two AI-powered tools. Tool A is a customer support bot that categorizes thousands of user emails daily into one of five fixed categories. Tool B is a creative writing assistant that generates unique story ideas based on highly varied and specific user requests. For which tool would it be more computationally advantageous to use a compact, pre-trained numerical instruction instead of a detailed text-based one? Justify your answer by explaining the relationship between the nature of the task and the efficiency of this type of instruction.

0

1

Updated 2025-10-06

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Evaluation in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science