Feat: Implement CLI arguments for dynamic university scraping #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

suyash469 wants to merge 1 commit into UC-OSPO-Network:main from suyash469:feat/cli-arguments

suyash469 commented Dec 23, 2025

Summary

Refactored main_scraping.py to replace hardcoded university lists with a standard Command Line Interface (CLI) using argparse.

Changes

Added argparse to allow dynamic selection of universities (e.g., python main_scraping.py --universities UCSD UCLA).
Added validation to check if the corresponding config file exists before attempting to scrape, preventing runtime crashes.
Preserved existing logging and variable naming conventions.

Testing

Tested with valid arguments (--universities UCSD) -> Success.
Tested with invalid arguments (--universities FAKE) -> Gracefully skipped with error message instead of crashing.


          Feat: Refactor scraping entry point to use argparse for CLI arguments

a4e8b7c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet