Add AL2023 Dockerfile equivalent to Deadline Cloud SMF worker AMI#206
Closed
leongdl wants to merge 1 commit intoaws-deadline:mainlinefrom
Closed
Add AL2023 Dockerfile equivalent to Deadline Cloud SMF worker AMI#206leongdl wants to merge 1 commit intoaws-deadline:mainlinefrom
leongdl wants to merge 1 commit intoaws-deadline:mainlinefrom
Conversation
Replicates the ~480 packages installed on top of base AL2023 Minimal AMI on Deadline Cloud service-managed fleet workers. Organized into logical layers: system tools, build toolchain, X11/Mesa/OpenGL, image libs, networking/NFS, Git, Python 3.11, Docker/containerd, and misc libraries. Useful for building and testing conda packages locally with matching GLIBC and library versions. Signed-off-by: David Leong <116610336+leongdl@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add AL2023 Dockerfile equivalent to Deadline Cloud SMF worker AMI
Replicates the ~480 packages installed on top of base AL2023 Minimal AMI on Deadline Cloud service-managed fleet workers. Organized into logical layers: system tools, build toolchain, X11/Mesa/OpenGL, image libs, networking/NFS, Git, Python 3.11, Docker/containerd, and misc libraries.
Useful for building and testing conda packages locally with matching GLIBC and library versions.
Fixes:
What was the problem/requirement? (What/Why)
Building and testing conda packages for Deadline Cloud SMF workers requires matching the exact system library versions (GLIBC, Mesa, X11, etc.) present on the worker AMI. Without a local equivalent, developers either test directly on workers (slow feedback loop) or use a generic AL2023 image that's missing ~480 packages the worker has, leading to "works locally, breaks on worker" issues.
What was the solution? (How)
Diffed the 768 installed packages on a live SMF worker against the 289-package AL2023 Minimal AMI baseline (April 2026) and created a Dockerfile that installs the delta, organized into logical layers:
EC2-specific packages (SSM agent, CloudWatch agent, NVIDIA toolkit, kernel modules) are intentionally excluded with comments explaining why and how to add GPU support if needed.
What is the impact of this change?
No impact on existing samples. This adds a new Dockerfile under
containers/al2023-deadline/that developers can use to replicate the SMF worker environment locally for conda package development and testing.How was this change tested?
docker build:Was this change documented?
The Dockerfile includes inline comments explaining each layer, the rationale for excluded packages, and instructions for adding NVIDIA GPU support.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.