Bellman Equation
Tags: #machine learningEquation
$$v_{\pi}(s)=\sum_{a}\pi(as)\sum_{s^{'},r}p(s^{'},rs,a)[r+\gamma v_{\pi}(s^{'})]$$Latex Code
v_{\pi}(s)=\sum_{a}\pi(as)\sum_{s^{'},r}p(s^{'},rs,a)[r+\gamma v_{\pi}(s^{'})]
Have Fun
Let's Vote for the Most Difficult Equation!
Introduction
Equation
Latex Code
v_{\pi}(s)=\sum_{a}\pi(as)\sum_{s^{'},r}p(s^{'},rs,a)[r+\gamma v_{\pi}(s^{'})]
Explanation
 : Value at state s in policy \pi
 : Value at state s^{'} in policy \pi
 : Probability of choosing action a given state s
 : Reward at state s
 : Reward discount factor \gamma
You can check more detailed information of Bellman Equation in this tutorial Introduction to Reinforcement Learning for more details.
Related Documents
Related Videos
Discussion
Comment to Make Wishes Come True
Leave your wishes (e.g. Passing Exams) in the comments and earn as many upvotes as possible to make your wishes come true

Timothy CookI'm keeping hope alive to pass this exam.Mark Jackson reply to Timothy CookYou can make it...20230804 00:00 
Sandra JacksonCraving a victory on this upcoming test.Julie Wright reply to Sandra JacksonNice~20240103 00:00 
Henry RiveraPlease let me pass this test.Randy Murphy reply to Henry RiveraYou can make it...20230819 00:00
Reply