An agent interacts with an environment over five time steps and receives the following sequence of rewards, starting from time step 1: [-1, +3, +10, -5, +2]. What is the cumulative future reward (also known as the return) calculated from time step 3?

An agent is at time step t. It must choose between two actions, Action A and Action B. If it chooses Action A, the sequence of rewards it will receive from time step t until the end of the episode is [+1, +1, +10]. If it chooses Action B, the sequence of rewards it will receive is [+5, -2, +5]. To maximize its total accumulated reward from this point forward, which action should the agent choose and why?

Evaluating Agent Action Sequences