Learn Before
Deconstructing a Shaped Reward Function
An AI agent is being trained to navigate a grid world to reach a goal square. The original reward function, , provides +10 for reaching the goal and -0.1 for every other step. To encourage faster learning, a new, transformed reward function, , is implemented. For a specific step that moves the agent from a square 5 units away from the goal to a square 4 units away, the agent receives a total transformed reward of +0.9. Based on the general formula for reward shaping, , what are the numerical values for the original reward and the shaping function for this specific step? Explain the purpose of the shaping function in this context.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Condition for Policy Invariance in Reward Shaping
A reinforcement learning agent is operating in an environment where taking a specific action in a given state results in a transition to a new state. The environment's original reward for this transition is -0.5. To guide the agent more effectively, a shaping function is added, which provides an additional reward value of +2.0 for this same transition. According to the standard formulation for reward shaping, what is the total transformed reward the agent receives?
Deconstructing a Shaped Reward Function
Analyzing Reward Components in a Maze Navigation Task