Make core::IContact auto purge when not in use like stack::IPeer objects

[robin-raymond]

This will save on memory of nothing is using the object at the core/stack level.