Skip to content

Fix cross-platform dotenv loading and enable parallel batch containers#4

Open
Linaqruf wants to merge 2 commits intomasterfrom
fix/dotenv-and-parallel-containers
Open

Fix cross-platform dotenv loading and enable parallel batch containers#4
Linaqruf wants to merge 2 commits intomasterfrom
fix/dotenv-and-parallel-containers

Conversation

@Linaqruf
Copy link
Copy Markdown
Owner

Summary

  • Cross-platform .env loading: Added load_dotenv() to utils.py — custom parser that reliably loads .env on Windows (bash source .env breaks on Git Bash due to CR/LF issues). Called in both main() and batch() local entrypoints.
  • Parallel batch containers: Added max_containers=100 to migrate_hf_to_ms, migrate_hf_to_ms_git, and migrate_ms_to_hf so batch starmap can run repos across multiple containers simultaneously (was defaulting to 1).
  • Docs: Updated CLAUDE.md with setup instructions, updated SPEC.md with v1.5.0 planned features (dry-run, selective migration, developer onboarding).

Test plan

  • load_dotenv() successfully loads tokens from .env on Windows
  • Batch migration of 16 datasets launched 13 parallel containers simultaneously
  • All 35 repos (19 models + 16 datasets) verified on ModelScope

🤖 Generated with Claude Code

Linaqruf and others added 2 commits February 11, 2026 09:48
- Add load_dotenv() to utils.py — custom .env parser that works on Windows
  (source .env breaks on Git Bash due to CR/LF issues)
- Call load_dotenv() in both main() and batch() local entrypoints
- Add max_containers=100 to migrate_hf_to_ms, migrate_hf_to_ms_git, and
  migrate_ms_to_hf so batch starmap can run repos in parallel
- Update CLAUDE.md with setup instructions and current status
- Update SPEC.md with v1.5.0 planned features (dry-run, selective migration)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
… guidance

- Simplify CLI commands in SKILL.md and migrate.md — load_dotenv() handles
  .env loading, no shell source needed
- Add hf repo delete CLI usage to verification-and-cleanup.md
- Add detached mode verification caveat (logs disconnect, verify via API)
- Fix Modal troubleshooting entry (modal token set, not token verify)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant