Skip to content

Fix Rate Limit, Add more details on jsonl#9

Open
dave-apmic wants to merge 12 commits intoai-twinkle:mainfrom
ap-mic-inc:main
Open

Fix Rate Limit, Add more details on jsonl#9
dave-apmic wants to merge 12 commits intoai-twinkle:mainfrom
ap-mic-inc:main

Conversation

@dave-apmic
Copy link

No description provided.

k1dav and others added 9 commits January 9, 2026 11:38
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…ctions

- Add --dataset-split train note for dataset download
- Add --dataset-info for checking dataset structure
- Fix upload path to include results/ prefix
- Add dataset path format and boto3 fallback to FAQ

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@lianghsun
Copy link
Member

感謝你的 PR!不過在這份 PR 進行 review 期間,main 分支已完成了一次模組化架構重構(#38),導致以下衝突:

  • twinkle_eval/evaluators.py → 已遷移至 twinkle_eval/runners/evaluator.py
  • twinkle_eval/logger.py → 已遷移至 twinkle_eval/core/logger.py
  • twinkle_eval/config.template.yaml → 已拆分為 twinkle_eval/config.multiple_choice.template.yaml / twinkle_eval/config.math.template.yaml

此 PR 目前無法直接合併,需要基於最新 main 分支進行 rebase,並將變更移植到對應的新路徑。

如果你有意願繼續維護這個 PR,請:

  1. git fetch upstream && git rebase upstream/main
  2. 將 rate limit 修正移至 twinkle_eval/runners/evaluator.py
  3. 將 logger 相關修正移至 twinkle_eval/core/logger.py
  4. 解決 main.py 的衝突

若有任何問題歡迎在這裡留言,或 tag @lianghsun / @teds-lin。感謝!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

3 participants