Action-Value Function Formula

An agent is learning to play a game where the goal is to maximize its final score. At a specific point in the game (a 'state'), the agent is considering several possible moves ('actions'). A function is used to estimate the total expected future score that can be achieved by taking a specific action from the current state and then playing optimally for the rest of the game. What does the output of this function represent for a given state-action pair?

Utility of Action-Specific Value Estimation

Choosing the Right Tool for Decision-Making