Analyzing Information Flow in a System
A system makes a decision, , after processing a sequence of items. Two different approaches for the final decision function, , are proposed. In both approaches, represents the cumulative average value after processing the first items.
Approach 1: Approach 2:
Analyze and contrast these two approaches. What is the fundamental difference in the information available to the function in each case?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A computational system processes the 5-word phrase 'deep learning models are powerful'. It generates a sequence of cumulative average values, where represents the average value after processing the first words. A function, denoted as , is then applied to this sequence to perform a final calculation. Based on the notation , what is the direct input to the function in this specific scenario?
Analyzing Information Flow in a System
Consider a system where a function
sprocesses a series ofkcalculated average vectors, denoted . The notation signifies that the functionsis applied to each vector individually, producing a sequence of outputs .