feat(tasks): integrate waymore for passive URL discovery

[Copilot]

Adds waymore integration for discovering URLs from Wayback Machine, Common Crawl, AlienVault OTX, URLScan, VirusTotal, and Intelligence X.

Implementation

• Task: secator/tasks/waymore.py as HttpCrawler with tags url, crawl, passive
• Options: All waymore CLI options mapped including:
  • Source providers (wayback, commoncrawl, otx, urlscan, virustotal, intelx)
  • Date filtering (from_date, to_date, capture_interval)
  • Filtering (regex_after, keywords_only, filter_codes, match_codes)
  • Limits (limit, limit_requests, limit_cc)
  • Source exclusions (exclude_wayback, exclude_commoncrawl, etc.)
• Input: URL or HOST (auto-converts URLs to hostname/path format)
• Output: Url objects with parameter deduplication to reduce noise
• Streaming: Uses --stream flag for real-time output parsing

Test Coverage

• Fixture: tests/fixtures/waymore_output.json
• Integration: Input http://testphp.vulnweb.com, expected output Url objects

Example Usage

from secator.tasks.waymore import waymore

# Basic usage
task = waymore('example.com')

# With options
task = waymore(
    'example.com',
    providers='wayback,commoncrawl',
    from_date='20230101',
    limit=1000,
    keywords_only='api,admin'
)

Original prompt

---

This section details on the original issue you should resolve

<issue_title>feat(tasks): waymore integration</issue_title>
<issue_description>Integrate waymore (https://github.com/xnl-h4ck3r/waymore) with Secator.
Make sure:

Look at all the options it provides and implement them
Find the right category and map the meta options correctly
Add a test fixture
Add test integration inputs / outputs</issue_description>

Comments on the Issue (you are @copilot in this section)

• Fixes feat(tasks): waymore integration #880

---

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

[coderabbitai]

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}