Skip to content

Add profile system for S3-compatible endpoints#4

Merged
vertix merged 7 commits intomainfrom
add-profile-system
Jan 7, 2026
Merged

Add profile system for S3-compatible endpoints#4
vertix merged 7 commits intomainfrom
add-profile-system

Conversation

@vertix
Copy link
Copy Markdown
Contributor

@vertix vertix commented Jan 7, 2026

Summary

  • Add profile system enabling access to multiple S3-compatible endpoints (MinIO, Nebius, etc.) simultaneously
  • Support anonymous/public bucket access via public=True parameter
  • Profiles can be registered by name or used inline as Profile objects
  • Add default_profile parameter to mirror() context manager

Example

import pos3

pos3.register_profile('nebius-public',
    endpoint='https://storage.eu-north1.nebius.cloud',
    public=True
)

with pos3.mirror():
    # Download from Nebius public bucket
    dataset = pos3.download('s3://public-data/dataset/', profile='nebius-public')
    
    # Upload to AWS (default credentials)
    results = pos3.upload('s3://my-bucket/results/')

Test plan

  • All existing tests pass
  • Added 9 new tests for profile functionality
  • Verified with real Nebius public bucket access

@vertix
Copy link
Copy Markdown
Contributor Author

vertix commented Jan 7, 2026

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e3717cc6d5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@vertix
Copy link
Copy Markdown
Contributor Author

vertix commented Jan 7, 2026

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f4aa045fa8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@vertix
Copy link
Copy Markdown
Contributor Author

vertix commented Jan 7, 2026

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e56deae2a8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@vertix
Copy link
Copy Markdown
Contributor Author

vertix commented Jan 7, 2026

@codex review

@chatgpt-codex-connector
Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🎉

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@vertix vertix merged commit 79e23c1 into main Jan 7, 2026
1 check passed
@vertix vertix deleted the add-profile-system branch January 7, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant