Online Course Support | Practical Reinforcement Learning

What are the differences between model-free and model-based settings?

ByAdmin October 9, 2021October 9, 2021

In a model-based setting, we know nothing about environment dynamics. An agent is learning by optimizing some parametric model.

In a model-based setting, we can find out which (reward, next state) pairs are possible given current state and action.

In a model-free setting, we know nothing about environment dynamics. Optimization of agent decisions is based solely on sample-based experiences of the world.

Model-free learning requires probabilities of possible next states and rewards but does not require a sample model (aka simulator, aka generative model)

In a model-free setting, we know which (reward, next state) pairs are possible given current state and action.

——————————————————————————————–

For long episodes and very short planning time RP should be as fast as possible, TP can be much slower.

RP and TP are conflicting policies — the one that performs the best becomes the final result of planning.

Random RP is best, since improving the quality of RP may reduce the quality of MCTS planning.

MCTS is relatively insensitive to the quality of RP. So we can use random RP, but it is always better to make RP as good as possible.

For long episodes and short planning time TP should be as fast as possible, RP can be much slower.

Online Course Support

Which criteria can be used to filter messages printed by the Log class?
ByAdmin July 12, 2021

Question 7Which criteria can be used to filter messages printed by the Log class? 1 point the tag of the message the text of the message the priority/level (debug, warning,…

Read More Which criteria can be used to filter messages printed by the Log class?
Online Course Support | Principles of Sustainable Finance

Three stages of sustainable finance (SF 1.0, 2.0 and 3.0) can be distinguished. At which stage are we now?
ByAdmin October 5, 2021October 5, 2021

2. Question 2 Three stages of sustainable finance (SF 1.0, 2.0 and 3.0) can be distinguished. At which stage are we now? 1 / 1 point In between SF 1.0 and SF…

Read More Three stages of sustainable finance (SF 1.0, 2.0 and 3.0) can be distinguished. At which stage are we now?
Online Course Support | Principles of Sustainable Finance

Which statement is true?
ByAdmin October 5, 2021October 5, 2021

4. Question 4 Which statement is true? 1 point Currently, the market value of S&P Listed firms depends more on intangible assets than tangible assets (84:16) Currently, market…

Read More Which statement is true?
Advanced Business Strategy | Online Course Support

Review: Why do strategists analyze the competitive life cycle?
ByAdmin September 14, 2021September 15, 2021

11. Question 11 Review: Why do strategists analyze the competitive life cycle? 1 / 1 point To identify which incumbent company to acquire To understand how to budget spending in order…

Read More Review: Why do strategists analyze the competitive life cycle?
Online Course Support | Prepare Data for Exploration

Which of the following are qualities of unreliable data? Select all that apply.
ByAdmin August 8, 2021August 8, 2021

3. Question 3 Which of the following are qualities of unreliable data? Select all that apply. 1 / 1 point Vetted Biased Correct Unreliable data is inaccurate, incomplete, and biased. Inaccurate Correct Unreliable…

Read More Which of the following are qualities of unreliable data? Select all that apply.
Advanced Competitive Strategy | Online Course Support

Which statements about the make-or-buy decision are true?
ByAdmin September 5, 2021September 5, 2021

8. Question 8 Which statements about the make-or-buy decision are true? 1 / 1 point Producing firms can pass on risks due to demand fluctuations to suppliers of inputs. This…

Read More Which statements about the make-or-buy decision are true?

Similar Posts