Skip to content

Project for a database class, traverses authorized webpages/domains and creates a(n) SQL script which catalogues the discoveries of the program. Web crawler portion taken from thenewboston: https://www.youtube.com/watch?v=nRW90GASSXE&index=1&list=PL6gx4Cwl9DGA8Vys-f48mAH9OKSUyav0q

Notifications You must be signed in to change notification settings

Veziik/databasebuilder

Repository files navigation

#databasebuilder

Project for a database class where we had to catalog a filesystem or entire domain, usage below:

Executable files and usage are as follows: singlefile.py <url/filepath> -- creates a .sql script from the metadata of a single file, local or otherwise domainscraper.py -- searches through all of a domain's files and produces a .sql script directory.py -- searches through all of a filesystem's files and produces a .sql script mergescripts.py -- merges all .sql files in the scripts folder

The program creates a scripts folder for all of the sql scripts it generates and places them into that folder

About

Project for a database class, traverses authorized webpages/domains and creates a(n) SQL script which catalogues the discoveries of the program. Web crawler portion taken from thenewboston: https://www.youtube.com/watch?v=nRW90GASSXE&index=1&list=PL6gx4Cwl9DGA8Vys-f48mAH9OKSUyav0q

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages