-
Notifications
You must be signed in to change notification settings - Fork 63
Open
Description
i used an array of urls to scrape, the number of urls i need to fetch are around 7500 urls ñ.ñ, i begin scraping and everything goes fine until the first 120 urls fetched, it starts going slooooooow... more and more, until it crashes and cannot fetch another one anymore, does the library supports heavy scraping i need to scrape tons of things :(
Metadata
Metadata
Assignees
Labels
No labels