Docs: Implement an alternative link checker #417
Description
In a recent Rockcraft build, the sphinx-build link checker spent six hours trying to reach a link to gnu.org. I've tried every timeout-related config setting available in the configuration, but none seem to stop it from infinitely looping.
I think it's caused by the FSF's recent work walling themselves off from DDoSing by LLM agents. Something about the response causes it to keep trying, possibly because of a limitation with Retry-After. Or, Sphinx's user agent might be blocked now. Or, FSF is sending bots into a maze.
Regardless of what other domains are doing, it shouldn't bog our builds. If other savvy sites do likewise in the future, we don't want to be surprised by blocked builds.
Sphinx's link checker has always been slow and its capabilities meagre. I'd like to pursue other link checking solutions.