A comprehensive collection of production-ready web scrapers for major e-commerce and marketplace websites

Scraper Bank is an open-source organization providing battle-tested, production-ready scrapers for extracting data from popular websites. All scrapers are built with multiple framework implementations (Python & Node.js) and optimized for reliability, performance, and anti-bot evasion.

• Amazon Scrapers - Product data, reviews, sellers, and category scrapers
• Target Scrapers - Product category, product data, and product search scrapers
• Walmart Scrapers - Product data, reviews, sellers, and category scrapers
• Best Buy Scrapers - Product category, product data, and product search scrapers
• eBay Scrapers - Product category, product data, and product search scrapers

• Booking.com Scrapers - Hotel listings, product data, and search scrapers

• ProductHunt Scrapers - Product listings, category, and search scrapers
• AppSumo Scrapers - Product category, product data, and product search scrapers

We're continuously expanding our collection! More scrapers for additional websites are in development. Stay tuned for updates.

Browse our repositories above and select the website you want to scrape.

Each repository offers multiple implementations:

Python:

• BeautifulSoup - Fast, lightweight HTML parsing
• Playwright - Modern browser automation with excellent JavaScript support
• Selenium - Industry-standard browser automation
• Scrapy - High-performance scraping framework (where available)

Node.js:

• Cheerio & Axios - Fast server-side HTML parsing
• Playwright - Modern browser automation
• Puppeteer - Chrome/Chromium automation

Go:

• HTTP Client - High-performance HTTP scraping (where available)

All scrapers integrate with ScrapeOps for:

• ✅ Proxy Rotation - Distribute requests across multiple IP addresses
• ✅ Request Header Optimization - Reduce bot detection
• ✅ Rate Limiting Management - Built-in retry logic and rate limiting
• ✅ CAPTCHA Handling - Advanced anti-bot evasion

Get your free API key: https://scrapeops.io/app/register/main

💡 Free Tier Available: ScrapeOps offers a generous free tier perfect for testing and small-scale scraping.

Each scraper includes detailed documentation:

• Installation instructions
• Usage examples
• Configuration options
• Output format specifications
• Troubleshooting guides

All scrapers in Scraper Bank are pre-configured to work with ScrapeOps. Here's how to use them:

Sign up at https://scrapeops.io/app/register/main and get your free API key.

Python:

import os

# Set your ScrapeOps API key
os.environ['SCRAPEOPS_API_KEY'] = 'your-api-key-here'

Node.js:

// Set your ScrapeOps API key
process.env.SCRAPEOPS_API_KEY = 'your-api-key-here';

The scrapers automatically use ScrapeOps proxy endpoints when configured:

Python Example:

import requests

# ScrapeOps proxy endpoint
proxy_url = f"http://scrapeops.headless_browser_mode=true:{SCRAPEOPS_API_KEY}@proxy.scrapeops.io:5353"

proxies = {
    'http': proxy_url,
    'https': proxy_url
}

response = requests.get(url, proxies=proxies)

Node.js Example:

const axios = require('axios');

const proxyUrl = `http://scrapeops.headless_browser_mode=true:${SCRAPEOPS_API_KEY}@proxy.scrapeops.io:5353`;

const response = await axios.get(url, {
    proxy: {
        host: 'proxy.scrapeops.io',
        port: 5353,
        auth: {
            username: 'scrapeops.headless_browser_mode=true',
            password: SCRAPEOPS_API_KEY
        }
    }
});

• Residential Proxies: Use residential IPs for better success rates
• Geolocation Targeting: Target specific countries/regions
• Browser Fingerprinting: Rotate browser fingerprints
• CAPTCHA Solving: Automatic CAPTCHA resolution (premium feature)

Documentation: https://docs.scrapeops.io

Create custom scrapers in seconds with ScrapeOps AI-powered code generator!

🔗 Visit: https://scrapeops.io/ai-web-scraping-assistant/scraper-builder

1. Enter Target URL: Paste the website URL you want to scrape
2. Describe Your Needs: Tell the AI what data you want to extract
3. Get Generated Code: Receive production-ready scraper code instantly
4. Customize & Deploy: Fine-tune the code and integrate with ScrapeOps

• ✅ Multi-Language Support: Generate code in Python, Node.js, or other languages
• ✅ Framework Selection: Choose from BeautifulSoup, Playwright, Selenium, Puppeteer, and more
• ✅ Automatic Selector Detection: AI identifies the best CSS/XPath selectors
• ✅ Anti-Bot Integration: Built-in ScrapeOps proxy and header optimization
• ✅ Error Handling: Includes retry logic and error handling
• ✅ Output Formatting: Structured JSON output ready to use

1. Go to scrapeops.io/ai-web-scraping-assistant/scraper-builder
2. Enter: "https://example.com/products"
3. Describe: "Extract product name, price, and rating"
4. Select: Python + Playwright
5. Click "Generate Code"
6. Copy the generated scraper code
7. Add your ScrapeOps API key
8. Run and enjoy! 🎉

• Be Specific: Clearly describe the data fields you need
• Provide Examples: Share example URLs or HTML snippets if possible
• Iterate: Refine your prompts for better results
• Test Locally: Always test generated code before production use

Depending on the repository, you can extract:

• Product Information: Names, prices, descriptions, images, ratings
• Product Categories: Category listings, navigation structures
• Search Results: Search query results, filters, pagination
• Reviews & Ratings: Customer reviews, ratings, helpful votes
• Seller Information: Seller profiles, ratings, store information
• Inventory Data: Stock status, availability, variants
• Pricing Data: Current prices, historical prices, discounts

Each repository's README provides detailed information about available data fields.

Modern websites employ sophisticated anti-bot measures. All Scraper Bank scrapers are designed to work with ScrapeOps to handle:

• ✅ IP Rotation: Distribute requests across multiple IPs
• ✅ Header Optimization: Mimic real browser headers
• ✅ Rate Limiting: Respectful request rates
• ✅ CAPTCHA Solving: Automatic CAPTCHA resolution (premium)
• ✅ Browser Fingerprinting: Rotate browser signatures

Important: Anti-bot measures vary by site and may change over time. CAPTCHA challenges may occur and cannot be guaranteed to be resolved automatically. Using proxies and browser automation can help reduce blocking, but effectiveness depends on the target site's specific anti-bot measures.

All scrapers output structured JSON data. Example output formats are included in each repository's example/ directories.

We welcome contributions! Whether it's:

• 🐛 Bug fixes
• ✨ New features
• 📝 Documentation improvements
• 🆕 New scraper implementations
• 🌐 New website scrapers

Please check each repository's contributing guidelines.

Each repository may have its own license. Please check individual repository LICENSE files.

• ScrapeOps Homepage: https://scrapeops.io
• ScrapeOps Documentation: https://docs.scrapeops.io
• AI Scraper Builder: https://scrapeops.io/ai-web-scraping-assistant/scraper-builder
• ScrapeOps API Dashboard: https://app.scrapeops.io

These scrapers are provided for educational and research purposes. Always:

• ✅ Respect websites' Terms of Service
• ✅ Follow robots.txt guidelines
• ✅ Use reasonable request rates
• ✅ Comply with applicable laws and regulations
• ✅ Respect website owners' intellectual property rights

The maintainers of Scraper Bank are not responsible for any misuse of these tools.

If you find Scraper Bank useful, please consider giving our repositories a ⭐ on GitHub!

Built with ❤️ using ScrapeOps