KeyError: 3 at time: 1.65088e+09

[forrestneo]

[2022-04-25 18:24:10,728 E 4497 4497] core_worker.cc:1274: Pushed Error with JobID: 01000000 of type: task with message: ray::RolloutWorker.sample()::Exiting (pid=4497, ip=172.17.0.3, repr=<ray.rllib.evaluation.rollout_worker.modify_class..Class object at 0x7f8f95c8cc40>)
File "/root/miniconda3/lib/python3.8/site-packages/ray/rllib/evaluation/rollout_worker.py", line 761, in sample
batches = [self.input_reader.next()]
File "/root/miniconda3/lib/python3.8/site-packages/ray/rllib/evaluation/sampler.py", line 104, in next
batches = [self.get_data()]
File "/root/miniconda3/lib/python3.8/site-packages/ray/rllib/evaluation/sampler.py", line 266, in get_data
item = next(self._env_runner)
File "/root/miniconda3/lib/python3.8/site-packages/ray/rllib/evaluation/sampler.py", line 634, in _env_runner
_process_observations(
File "/root/miniconda3/lib/python3.8/site-packages/ray/rllib/evaluation/sampler.py", line 963, in _process_observations
callbacks.on_episode_end(
File "/root/neural-mmo/baselines/rllib_wrapper.py", line 305, in on_episode_end
policy = inv_map[policy_id].name
KeyError: 3 at time: 1.65088e+09