HTTP requests to in-scope targets rate limits

[Giardi77]

Description
Currently the only http rate limits configurable are those for ffuf and nuclei, but it happens often to me to get ip-banned for the huge amount of traffic that bbot is generating.

Personally i would prefer to let a scan running for 3 day than getting banned :/

[TheTechromancer]

This is a reasonable request and something that should be added in the future. We're currently working on rustifying BBOT's web engine, which seems like a good place to put the rate-limiting logic.

[gata-bbs]

And why not reducing the web_requests_per_second in the bbot config file (ref)?

[Giardi77]

that is strange.
I can't see it actually used in the code, am i missing something?
Or maybe they are just using an llm for documentation and it hallucinated an unexisted config

[TheTechromancer]

The option was used originally but removed during the web engine rewrite. It will be re-added in the rust implementation.

[liquidsec]

voila - #2992

[liquidsec]

will be present in 3.0