Skip to content
@spider-rs

spider-rs

Your friendly neighborhood spiderbot.

Popular repositories Loading

  1. spider spider Public

    Web crawler and scraper for Rust

    Rust 2k 165

  2. spider-py spider-py Public

    Spider ported to Python

    Rust 97 15

  3. headless-browser headless-browser Public

    Headless browser - reliable high performance setup for cloud providers like Fargate, CloudRun, K8, and more.

    Rust 74 6

  4. spider-nodejs spider-nodejs Public

    Spider ported to Node.js

    Rust 55 10

  5. html2md html2md Public

    HTML to markdown for Rust

    HTML 49 1

  6. ua_generator ua_generator Public

    Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android

    Rust 34 3

Repositories

Showing 10 of 24 repositories
  • spider_network_blocker Public

    Network blocking lists on ads, scripts, and analytics for Spider

    spider-rs/spider_network_blocker’s past year of commit activity
    Rust 1 MIT 0 0 0 Updated Nov 11, 2025
  • spider Public

    Web crawler and scraper for Rust

    spider-rs/spider’s past year of commit activity
    Rust 2,038 MIT 165 2 0 Updated Nov 11, 2025
  • ua_generator Public

    Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android

    spider-rs/ua_generator’s past year of commit activity
    Rust 34 MIT 3 0 0 Updated Nov 11, 2025
  • chromey Public

    Concurrent high-level API to control Chrome over the DevTools Protocol for Rust - 100x performance

    spider-rs/chromey’s past year of commit activity
    Rust 28 Apache-2.0 5 2 0 Updated Nov 11, 2025
  • spider-clients Public

    Python, Javascript, and Rust libraries for the Spider Cloud API.

    spider-rs/spider-clients’s past year of commit activity
    Rust 19 MIT 9 0 0 Updated Nov 6, 2025
  • spider_fingerprint Public

    The fingerprinting library for Rust

    spider-rs/spider_fingerprint’s past year of commit activity
    Rust 10 MIT 0 0 0 Updated Nov 2, 2025
  • firewall Public

    Firewall for Rust

    spider-rs/firewall’s past year of commit activity
    Rust 0 MIT 0 0 0 Updated Jul 19, 2025
  • case_insensitive_string Public

    A case-insensitive string for Rust

    spider-rs/case_insensitive_string’s past year of commit activity
    Rust 4 MIT 1 0 0 Updated Jul 16, 2025
  • spider_transformations Public

    HTML transformation library for Rust

    spider-rs/spider_transformations’s past year of commit activity
    Rust 2 MIT 0 0 0 Updated Jul 8, 2025
  • headless-browser Public

    Headless browser - reliable high performance setup for cloud providers like Fargate, CloudRun, K8, and more.

    spider-rs/headless-browser’s past year of commit activity
    Rust 74 MIT 6 0 0 Updated Jul 6, 2025

Top languages

Loading…

Most used topics

Loading…