Skip to content

Detect Woker failure #9

@truemped

Description

@truemped

If a worker dies while processing a CrawlUri the Master may never notice that the specific CrawlUri has never finished. This could lead to problems especially when crawling many hosts, since the host is blocked from then on.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions