Automated web scraping system to collect real-time flight prices from various airline and travel websites.
To run this project, you need to have Docker installed on your system. You can follow this guide to install and configure it properly:
Getting Started with R and Docker
The following R packages are used in this project:
-
rvest: Allows easy extraction of data from web pages.
- Documentation: https://rvest.tidyverse.org
-
RSelenium: Provides an interface to control web browsers via Selenium WebDriver.
- Documentation: https://cran.r-project.org/web/packages/RSelenium/index.html We are going to use Mozilla containers.
Make sure to install these packages before running the code.