-
Notifications
You must be signed in to change notification settings - Fork 18
Doubt Regarding rollout() function #24
Copy link
Copy link
Open
Description
In the rollout() function, at https://github.com/rail-berkeley/rlkit/blob/master/rlkit/samplers/rollout_functions.py
A condition is given that if done is True, then terminal will also turn true.
terminal = False
if done:
# terminal=False if TimeLimit caused termination
if not env_info.pop('TimeLimit.truncated', False):
terminal = True
terminals.append(terminal)
dones.append(done)
actions.append(a)
next_observations.append(next_o)
raw_next_obs.append(next_o)
agent_infos.append(agent_info)
env_infos.append(env_info)
path_length += 1
if done:
breakNow, in all of the .json files, it was specified that ignore_done=True, which means done is always false.
"eval_environment_kwargs": {
"control_freq": 20,
"controller": "OSC_POSE",
"env_name": "Lift",
"hard_reset": false,
"horizon": 500,
"ignore_done": true,
"reward_scale": 1.0,
"robots": [
"Sawyer"
]
},
"expl_environment_kwargs": {
"control_freq": 20,
"controller": "OSC_POSE",
"env_name": "Lift",
"hard_reset": false,
"horizon": 500,
"ignore_done": true,
"reward_scale": 1.0,
"robots": [
"Sawyer"
]Can anyone please explain this part?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels