Build a web scraper

[wanjauk]

The web scraper will be used to get the data from publisher pages and existing APIs automatically. Any resources with information where researchers can publish at a waived or subsidised APC will be useful in providing content to the website. We will be looking to automate this process and make use of GitHub Actions or CI to extract the data and add to the GitHub pages.

[kipkurui]

Owing to the unstructured nature of the information on various publisher's websites, I am not sure if this is possible, but we'll keep exploring. The current solution is to use crowd-sourcing on the website through a G-Form, which feeds to the website directly after review and approval.