Anchor Links (to other pages) get disrupted when

I am using this package together with gatsby and got a nice perfomance boost.

Unfortunately anchor links get disrupted when you use lazy hidration on a page. Specifically anchor links to other pages, not same page anchor links.

Anyone got any idea what could cause this or how to fix it?