Online Course Support | Practical Reinforcement Learning

What are the differences between model-free and model-based settings?

ByAdmin October 9, 2021October 9, 2021

In a model-based setting, we know nothing about environment dynamics. An agent is learning by optimizing some parametric model.

In a model-based setting, we can find out which (reward, next state) pairs are possible given current state and action.

In a model-free setting, we know nothing about environment dynamics. Optimization of agent decisions is based solely on sample-based experiences of the world.

Model-free learning requires probabilities of possible next states and rewards but does not require a sample model (aka simulator, aka generative model)

In a model-free setting, we know which (reward, next state) pairs are possible given current state and action.

——————————————————————————————–

For long episodes and very short planning time RP should be as fast as possible, TP can be much slower.

RP and TP are conflicting policies — the one that performs the best becomes the final result of planning.

Random RP is best, since improving the quality of RP may reduce the quality of MCTS planning.

MCTS is relatively insensitive to the quality of RP. So we can use random RP, but it is always better to make RP as good as possible.

For long episodes and short planning time TP should be as fast as possible, RP can be much slower.

Online Course Support

Your friend Stephano claims that he can predict the sales at your new ice cream store using a process that he calls “temporal temperature intuition.” Your sales for the first four days are $1000, $1100, $1600, and $1100. Stephano’s predictions for those four days were $1100, $1500, $1500, and $1300. Compute his R-squared in order to determine whether his model is GOOD or NO GOOD.

ByAdmin July 29, 2021

6. Question 6 Your friend Stephano claims that he can predict the sales at your new ice cream store using a process that he calls “temporal temperature intuition.” Your sales…

Online Course Support | Storytelling and influencing: Communicate with impact

Why do you need to use simple language in your presentation?

ByAdmin September 18, 2021September 19, 2021

3. Question 3 Why do you need to use simple language in your presentation? 1 / 1 point So that it is easier for the speaker to look impressive So that…

Construction Cost Estimating and Cost Control | Online Course Support

Which of these work packages have overrunning budget? (Select all that apply)

ByAdmin September 7, 2021September 7, 2021

6. Question 6 Which of these work packages have overrunning budget? (Select all that apply) 1 / 1 point A.10 Work packages are considered overrunning budget if the CPI of…

Online Course Support

Sensors and Devices

ByAdmin June 1, 2020September 28, 2020

1. You are designing an IoT system that measures a number of environmental factors in factory: light, temperature, oxygen levels, air particle levels, and humidity. You plan on placing sensors/devices…

Online Course Support

If output equals 40 \sqrt{K}40K, the savings rate equals 10% and the depreciation rate is 20%, what is the long run equilibrium level of OUTPUT?

ByAdmin July 29, 2021

9. Question 9 If output equals 40 \sqrt{K}40K, the savings rate equals 10% and the depreciation rate is 20%, what is the long run equilibrium level of OUTPUT? 800

Corporate Strategy | Online Course Support

You are working at the headquarters of Maia Magnificent, which produces mountaineering and ski equipment. Your CEO has asked you to calculate the enterprise value and equity value per share. What is your answer?

ByAdmin September 13, 2021September 13, 2021

4. Question 4 You are working at the headquarters of Maia Magnificent, which produces mountaineering and ski equipment. Your CEO has asked you to calculate the enterprise value and equity…

Similar Posts