Skip to content

feat(lib-storage): S3TransferManager #7238

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 37 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
f70735f
feat(lib-storage): add S3 Transfer Manager
lukachad Jun 11, 2025
49fd801
feat(lib-storage): concurrent requests
kuhe Jul 21, 2025
1938251
feat(lib-storage): spec updates
kuhe Jul 21, 2025
c4bf56a
Merge pull request #4 from lukachad/revised-sep-requirements
kuhe Jul 21, 2025
879000e
feat: addressed pr comments
lukachad Jul 21, 2025
94c1e1b
feat: addresses change requests for range and part validation
lukachad Jul 22, 2025
a77718f
Merge pull request #3 from lukachad/concurrency
lukachad Jul 22, 2025
deb53b5
feat: validate part and range test cases
lukachad Jul 22, 2025
16264c0
feat: creating tests for join-streams, made browser specific
lukachad Jul 22, 2025
e558dea
feat: changed join-streams path in browser.spec
lukachad Jul 23, 2025
c726213
feat(lib-storage): readme for S3TransferManager
lukachad Jul 24, 2025
3d26103
feat(lib-storage): more expect statements in multipartdownload tests …
lukachad Jul 24, 2025
c2d6863
feat(lib-storage): added try catch and dispatches for transferFailedE…
lukachad Jul 25, 2025
832e6d7
feat: fixed unhandled promise rejection issue, added unit and e2e tes…
lukachad Jul 28, 2025
3655319
feat: part and range handles 0 byte objects, added helper function fo…
lukachad Jul 28, 2025
2559e6a
feat: custom range download tests and fixes
lukachad Jul 28, 2025
53c730f
feat: fixing unhandled promise error
lukachad Jul 29, 2025
53ef260
feat: cr revisions
lukachad Jul 29, 2025
cf4964f
chore: debug
kuhe Jul 29, 2025
d44f0cc
feat: promise.all temp fix for promise unhandled rejection issue
lukachad Jul 29, 2025
164fcee
chore: update join-streams browser to be consistent with join-streams…
lukachad Jul 30, 2025
f367640
chore: code annotations S3TM functions
lukachad Jul 30, 2025
4450b16
chore: readme updates for s3transfermanager
lukachad Jul 30, 2025
927c394
chore: removed dependencies and unused internal event handler
lukachad Jul 30, 2025
41ee715
chore: import cleanup and removed dependencies
lukachad Jul 30, 2025
21dffe4
Merge pull request #5 from lukachad/testing
lukachad Jul 30, 2025
49022b9
Merge branch 'transfer-manager' into debugging
lukachad Jul 30, 2025
987d3ad
Merge pull request #6 from lukachad/debugging
lukachad Jul 30, 2025
82cc0b5
chore: reademe updates
lukachad Jul 30, 2025
21fdc36
Merge branch 'transfer-manager' into add-documentation
lukachad Jul 30, 2025
8daad36
chore: cr changes for readme and added download() examples
lukachad Jul 30, 2025
060045f
chore: deleted redundant example code file
lukachad Jul 30, 2025
4fc0d2f
chore: cr nits
lukachad Jul 30, 2025
bb26df3
Merge pull request #7 from lukachad/add-documentation
lukachad Jul 30, 2025
63040cc
chore: fixed yarn lockfile
lukachad Jul 31, 2025
1bd3255
chore: deleted unused file
lukachad Jul 31, 2025
2a68516
chore: improved async iterable error handling with minimal performanc…
lukachad Aug 4, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .vscode/settings.json
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,6 @@
"source.fixAll.eslint": "explicit"
},
"typescript.tsdk": "node_modules/typescript/lib",
"vitest.disableWorkspaceWarning": true
"vitest.disableWorkspaceWarning": true,
"java.configuration.updateBuildConfiguration": "interactive"
}
5 changes: 4 additions & 1 deletion lib/lib-storage/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,10 @@
"clean": "rimraf ./dist-* && rimraf *.tsbuildinfo",
"extract:docs": "api-extractor run --local",
"test": "yarn g:vitest run",
"test:e2e": "yarn g:vitest run -c vitest.config.e2e.ts --mode development",
"test:watch": "yarn g:vitest watch",
"test:browser": "yarn g:vitest run -c vitest.config.browser.ts",
"test:browser:watch": "yarn g:vitest watch -c vitest.config.browser.ts",
"test:e2e": "yarn g:vitest run -c vitest.config.e2e.ts --mode development",
"test:e2e:watch": "yarn g:vitest watch -c vitest.config.e2e.ts"
},
"engines": {
Expand Down Expand Up @@ -59,6 +61,7 @@
},
"browser": {
"./dist-es/runtimeConfig": "./dist-es/runtimeConfig.browser",
"./dist-es/s3-transfer-manager/join-streams": "./dist-es/s3-transfer-manager/join-streams.browser",
"fs": false,
"stream": "stream-browserify"
},
Expand Down
1 change: 1 addition & 0 deletions lib/lib-storage/src/index.ts
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
export * from "./Upload";
export * from "./s3-transfer-manager/index";
export * from "./types";
3 changes: 2 additions & 1 deletion lib/lib-storage/src/lib-storage.e2e.spec.ts
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,8 @@ import { afterAll, beforeAll, describe, expect, test as it } from "vitest";

import { getIntegTestResources } from "../../../tests/e2e/get-integ-test-resources";

describe("@aws-sdk/lib-storage", () => {
// todo(s3-transfer-manager): unskip
describe.skip("@aws-sdk/lib-storage", () => {
describe.each([undefined, "WHEN_REQUIRED", "WHEN_SUPPORTED"])(
"requestChecksumCalculation: %s",
(requestChecksumCalculation) => {
Expand Down
Loading
Loading