Skip to content

See into using scrapy in the project #17

@mazz3rr

Description

@mazz3rr

I need to finish watching the tutorial first.

  • Part 1 - Scrapy & Course Introduction
  • Part 2 - Setup Virtual Env & Scrapy
  • Part 3 - Creating a Scrapy Project
  • Part 4 - Build your First Scrapy Spider
  • Part 5 - Build Discovery & Extraction Spider
  • Part 6 - Cleaning Data with Item Pipelines
  • Part 7 - Saving Data to Files & Databases
  • Part 8 - Fake User-Agents & Browser Headers
  • Part 9 - Rotating Proxies & Proxy APIs
  • Part 10 - Run Spiders in Cloud with Scrapyd
  • Part 11 - Run Spiders in Cloud with ScrapeOps
  • Part 12 - Run Spiders in Cloud with Scrapy Cloud
  • Part 13 - Conclusion & Next Steps

I'm on the fence with this course, so maybe: https://www.youtube.com/@JohnWatsonRooney/videos
Starting with: https://www.youtube.com/watch?v=hCARQVJy_mk

Probably the best approach (involves reading :D), but I have to go easy on this task, because it's causing me to lose interest in the project. That has to be a side-job, not a main activity.

Good moment would be after completing the Goodreads part and getting into other providers.

Metadata

Metadata

Assignees

No one assigned

    Labels

    researchNeeds learning about

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions