Critic Network Loss in A2C

Training the Value Function with a Reward Model

In an actor-critic learning process, an agent is being trained. It is observed that the agent repeatedly takes actions that lead to states with poor long-term outcomes. Assuming the action-selection mechanism is functioning correctly based on its inputs, which of the following describes the most probable malfunction in the state-value estimation component that would cause this behavior?

Debugging an Actor-Critic Agent's Performance

The Critic's Role as a Baseline