-
Notifications
You must be signed in to change notification settings - Fork 10
Open
Labels
Description
Support pip, apt resources in addition to the current S3 and HTTP resources.
Pros:
- This helps track provenance information relevant to resources that went into a job. A secondary feature would be a toggle for the user to specify that the job should be run with exactly the same version.
- Fetching resources from the internet is ideally done outside the execution script. This allows us to run the script code without outgoing connections.
Cons:
- Compatibility with older jobs ?
- If the user uses some exotic package management system, supporting that is added work the worker has to do. Say, some julia/R package?