Skip to content

Fix semimonthly socrata upload #1020

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
wrridgeway merged 7 commits into from
Apr 22, 2026
Merged

Fix semimonthly socrata upload #1020

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
4526a83
More verbose event printing
wrridgeway Apr 22, 2026
64636a5
Temp set workflow dispatch to trigger semimonthly tag
wrridgeway Apr 22, 2026
770ec9a
Temp remove asset requirement
wrridgeway Apr 22, 2026
ce00dad
Check if newline is messing things up
wrridgeway Apr 22, 2026
97e28a7
Revert "Check if newline is messing things up"
wrridgeway Apr 22, 2026
5a6a2d3
Use strip chomping
wrridgeway Apr 22, 2026
226261f
Revert temp yaml changes
wrridgeway Apr 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/socrata_upload.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ on:
# We use these schedules to determine the value of the `UPLOAD_SCHEDULE`
# env var below, so make sure to change that env var definition if you
# change any of these schedules.
#
#
# Run a monthly job on the first of every month at 11am UTC (6am UTC-5).
- cron: '0 11 1 * *'
# Run a semi-monthly job on the fifteenth of every month at 11am UTC (6am UTC-5).
Expand Down Expand Up @@ -92,7 +92,7 @@ jobs:
# These cron expressions are shared by the `on.schedule` workflow
# attribute defined above, so make sure to change that attribute
# definition alongside any changes you make here
UPLOAD_SCHEDULE: >
UPLOAD_SCHEDULE: >-
${{ github.event.schedule == '0 11 1 * *' && 'monthly' ||
github.event.schedule == '0 11 15 * *' && 'semimonthly' || '' }}
run: python ./socrata/socrata_upload.py
8 changes: 7 additions & 1 deletion socrata/socrata_upload.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -491,7 +491,13 @@ def socrata_upload(asset_info, overwrite=False, years=None):


if __name__ == "__main__":
print(f"Running upload for event type: {os.getenv('WORKFLOW_EVENT_NAME')}")
event_type = " ".join(
filter(
None,
[os.getenv("UPLOAD_SCHEDULE"), os.getenv("WORKFLOW_EVENT_NAME")],
)
)
print(f"Running upload for event type: {event_type}")
Comment on lines +494 to +500
Copy link
Copy Markdown
Member Author

@wrridgeway wrridgeway Apr 22, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just adding more printing here so it's easier to see what the script is being passed.


# Retrieve asset(s)
all_assets = parse_assets(os.getenv("SOCRATA_ASSET"))
Expand Down
Loading