Skip to content

Conversation

@piohei
Copy link
Contributor

@piohei piohei commented Jan 27, 2025

Loading from s3 directly into memory than downloading file to disk and then loading it from disk improved start time from >15min to <5min.

@piohei piohei marked this pull request as ready for review January 31, 2025 08:09
@piohei piohei merged commit 05821ea into master Feb 3, 2025
7 checks passed
@piohei piohei deleted the piohei/add_start_from_s3 branch February 3, 2025 11:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants