Skip to content

Fix semimonthly socrata upload#1020

Merged
wrridgeway merged 7 commits intomasterfrom
fix-semimonthly-update-selection
Apr 22, 2026
Merged

Fix semimonthly socrata upload#1020
wrridgeway merged 7 commits intomasterfrom
fix-semimonthly-update-selection

Conversation

@wrridgeway
Copy link
Copy Markdown
Member

@wrridgeway wrridgeway commented Apr 22, 2026

I've reverted some of the changes to socrata_upload.yaml, but you can see what they were like when I successfully triggered a semimonthly scheduled workflow here (disabled requirement for user to define assets, workflow_dispatch event returns semimonthly for UPLOAD_SCHEDULE).

This let me print what was being passed to UPLOAD_SCHEDULE and it seems like it was semimonthly but with a newline at the end. Using a folded block scalar with strip chomping >- for UPLOAD_SCHEDULE sorts this out.

You can see a workflow with the unwanted newline in UPLOAD_SCHEDULE here.

@wrridgeway wrridgeway self-assigned this Apr 22, 2026
@wrridgeway wrridgeway linked an issue Apr 22, 2026 that may be closed by this pull request
Comment thread socrata/socrata_upload.py
Comment on lines +494 to +500
event_type = " ".join(
filter(
None,
[os.getenv("UPLOAD_SCHEDULE"), os.getenv("WORKFLOW_EVENT_NAME")],
)
)
print(f"Running upload for event type: {event_type}")
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just adding more printing here so it's easier to see what the script is being passed.

@wrridgeway wrridgeway marked this pull request as ready for review April 22, 2026 18:58
@wrridgeway wrridgeway requested a review from a team as a code owner April 22, 2026 18:58
@wrridgeway wrridgeway changed the title Fix semimonthly upload Fix semimonthly socrata upload Apr 22, 2026
Copy link
Copy Markdown
Member

@jeancochrane jeancochrane left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Such a devious little bug. Nice catch!

@wrridgeway wrridgeway merged commit eececaf into master Apr 22, 2026
9 checks passed
@wrridgeway wrridgeway deleted the fix-semimonthly-update-selection branch April 22, 2026 19:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Twice-a-month Socrata refresh updated all assets

2 participants