This will make our restore probably safe as state can't change radically. This shouldn't affect fuzzing as nothing is actively changing IRQ and memory bases