Skip to content

Refactor script to run on distributed clusters #56

@jathavaan

Description

@jathavaan

Task description

Refactor the script to run each partition computation on a distributed cluster. Keep DuckDB in the script, but rewrite it to pass runtime arguments that include the partition ID. The partition ID should be a H3 hash (see #55 for more information). Test the script on a local Kubernetes cluster using kind.

Developer tasks

No response

Sub-issues

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions