Problems with the performance

[DongChen06]

Hi author, I ran your code by commenting the items related to TASK_ROOT_DIR. Then I tried to run the environment Acrobot-v1 with the config file acro_config.ini and remained other things unchanged. While the performance is really bad and it seems the network doesnot work at all. Do I need to change any other codes to make it? Thanks!

[cts198859]

This repo was implemented long time ago and I could not remember the details. Based on your screenshot, A2C never explored a "successful" reward so it did not learn. Try increasing ENTROPY_INIT or decreasing NUM_STEP in your config, or try using PPO instead.

[lylyjy]

how to define TASK_ROOT_DIR. It says KeyError: 'TASK_ROOT_DIR'.
Thanks!