steam crawling exercise. ideas:
- using requests to visit 'https://store.steampowered.com/search/?'
- go to each page individually, find title, date, rating, popularity, price, publisher, developers, populartag, genre,
- use pandas to clean the requested page, convert genre and popular tags to one hot variable
issues:
-
Some foreign games might contain illegible characters
use simple algorithms to remove special characters -
Agecheck
physically visit the page to get the cookie