Add GitHub Action test for notebook utilities #16
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a comprehensive GitHub Actions workflow to test the notebook utilities as requested in the issue. The workflow validates that the
00-notebookutils.pyfile can be successfully imported and executed in a containerized environment.Implementation Details
The new
.github/workflows/test.ymlworkflow includes a container test job:Container Test Job
test_container_notebook_utils.py) inside the container environment00-notebookutils.pyexecution and validates that all imports work correctly and expected client variables are createdKey Features
test_container_notebook_utils.pystored in the repository instead of inline script creationunittest.mockto mock MinIO, Spark, and other external services to prevent network callsgovernance,minio,task_service,spark_cluster) are successfully createdTest Validation
The test script validates that:
00-notebookutils.pyfile exists and has valid Python syntaxThis ensures the notebook environment will work correctly when the container is deployed and users import the utilities in their Jupyter notebooks.
Fixes #15.
✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.