Learn Before
Choosing an Aggregation Strategy for Financial Data Extraction
A financial tech company is considering two methods for combining multiple language model outputs into a single, final answer. Review the case study and the proposed methods, then recommend the most suitable method and justify your choice.
Proposed Methods:
- Majority Voting: Select the exact text string that appears most frequently among the generated outputs.
- Maximum Content Overlap: Select the output that shares the most common words and phrases with the other generated outputs.
Which combination strategy would you recommend for this task? Justify your recommendation by explaining the primary weakness of the other strategy in this specific context.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A developer is using a technique to improve the reliability of a language model's output. For a single request to summarize a text about cellular biology, the model generates the four different one-sentence summaries listed below. After processing these four candidates, the system selects 'Summary A' as the final output.
- Summary A: The mitochondrion is the cell's power plant, generating ATP through cellular respiration.
- Summary B: Often called the powerhouse of the cell, the mitochondrion produces the energy currency, ATP.
- Summary C: The primary role of the ribosome is to synthesize proteins for the cell.
- Summary D: The mitochondrion, known as the cell's powerhouse, is responsible for creating ATP.
Based on the provided summaries and the final selected output, which combination method was most likely used to aggregate the candidates?
Choosing an Aggregation Strategy for Financial Data Extraction
Applying Combination Strategies in Prompt Ensembling