I'm running LibreCrawl via Docker and have developed a custom plugin for batch analysis. I need to analyze a fixed list of URLs without discovering new links.
My Requirements:
Depth 0: The UI forces a minimum depth of 1. How can I set it to 0 so it only crawls my seed list?
Redirect URLs: For 3xx status codes, I need to capture the final destination URL. Where can I find this field in the onDataUpdate object?
Docker Config: Since I'm in a container, which file should I modify to bypass the min="1" depth restriction?
I've already successfully mounted my plugin, but the engine still explores internal links, cluttering my data. Any guidance would be appreciated!
I'm running LibreCrawl via Docker and have developed a custom plugin for batch analysis. I need to analyze a fixed list of URLs without discovering new links.
My Requirements:
Depth 0: The UI forces a minimum depth of 1. How can I set it to 0 so it only crawls my seed list?
Redirect URLs: For 3xx status codes, I need to capture the final destination URL. Where can I find this field in the onDataUpdate object?
Docker Config: Since I'm in a container, which file should I modify to bypass the min="1" depth restriction?
I've already successfully mounted my plugin, but the engine still explores internal links, cluttering my data. Any guidance would be appreciated!