Skip to content

PRIME-RL Dev Branch #483

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

PRIME-RL Dev Branch #483

Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
bff61b6
Allow setting subset name
mikasenghaas Oct 20, 2025
b97441d
refactor exposed util functions
mikasenghaas Oct 20, 2025
2fa4086
Revert setting config name
mikasenghaas Oct 20, 2025
6d645fa
Serialize info column
mikasenghaas Oct 21, 2025
6f9a0ae
Merge branch 'main' into prime-rl
mikasenghaas Oct 21, 2025
aafe24f
Merge branch 'mika/serialize-info' into prime-rl
mikasenghaas Oct 21, 2025
66318f6
Merge branch 'mika/upload-as-subset' into prime-rl
mikasenghaas Oct 21, 2025
9046939
Merge branch 'main' into prime-rl
mikasenghaas Oct 22, 2025
69ff14a
Allow passing semaphore directly
mikasenghaas Oct 22, 2025
0c673ed
Test passing semaphore directly
mikasenghaas Oct 22, 2025
980edda
Correctly set precedence in interleaved case
mikasenghaas Oct 22, 2025
240f778
Copy global semaphore
mikasenghaas Oct 22, 2025
81972bc
Do not allow semaphore sharing
mikasenghaas Oct 22, 2025
901cebf
Remove tmp script
mikasenghaas Oct 22, 2025
d98c139
Merge branch 'mika/pass-semaphore' into prime-rl
mikasenghaas Oct 22, 2025
a793bf6
Merge branch 'main' into prime-rl
mikasenghaas Oct 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion verifiers/utils/eval_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ def make_dataset(results: GenerateOutputs, **kwargs) -> Dataset:
"total_ms": [s["timing"]["total_ms"] for s in results.state],
}
if save_info:
results_dict["info"] = results.info
results_dict["info"] = [json.dumps(info) for info in results.info]
if save_answer:
results_dict["answer"] = results.answer
for k in results.metrics:
Expand Down
Loading