Skip to content

Projekt-BE/Scraper

Repository files navigation

What is it?

Pack of scripts allowing fast and automated population of PrestaShop database with categories, products and images. Data is scraped from www.udemy.com. Script is developed for university project.

Scripts:

  • Data scraper - get_courses_info_from_udemy.py
  • Database population - import_data_to_prestashop.py

How to execute it?

Python:
  • Python 3.7 or newer required.
  • To install all required dependencies: pip install -r requirements.txt
WebDriver:

Script uses Firefox webdriver for automated web browsing. Path of the webdriver needs to be specified in system's PATH

Scripts execution:

  • python get_courses_info_from_udemy.py
Script scraping www.udemy.com for ~500 courses required for University Project. 
Prepared data can be later imported with the second script.

  • python import_data_to_prestashop.py -k KEY
Script importing categories, courses and images to PrestaShop

optional arguments:
  -h, --help         show this help message and exit
  
required arguments:
  -k KEY, --key KEY  Key for PrestaShop webservice

About

Scripts scraping Udemy website and populating PrestaShop with the results.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages