Create an Abstract class for processors that gives each processor a similar behaviour. This class should introduce a basic chain of decision methods that may determine if the given processor should work on the current CrawlUri.
Ideas for decision methods:
- decide on mime type
- decide on url
- decide on HTTP status codes
- ...
Create an Abstract class for processors that gives each processor a similar behaviour. This class should introduce a basic chain of decision methods that may determine if the given processor should work on the current CrawlUri.
Ideas for decision methods: