Simple scripts written in both PHP and Python to scrape the data from IGN Website to scrape a list of Top 100 Comic Book Villains of All Time 🔪 (because villians are way more cool than heroes) and save in a MySQL database. Then display it in a list one-page format which was not present on IGN original website.
I basically built this scraper so that I could read about all the villians on a single page and I don't need to click on NEXT for every other villian (Yeah, I am lazy 😪).
- Import MySQL dump file in your database
- Add database and user credentials in respective files (connection.inc.php for PHP and DBdetails.py for Python)
- Run following instruction in your terminal
For PHP
php /scrapper/php/fetch_data.phpFor Python
python /scrapper/python/main.pyTop Frame 
Bottom Frame 