We cache the signature, but don't cache the serialized ENR. We can save a lot of repeated work by caching. :)