Skip to content

Commit ad58fed

Browse files
use correct hf subset for ifbench multiturn (#1061)
1 parent af6b5b4 commit ad58fed

File tree

1 file changed

+1
-1
lines changed
  • src/lighteval/tasks/tasks/ifbench

1 file changed

+1
-1
lines changed

src/lighteval/tasks/tasks/ifbench/main.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -168,7 +168,7 @@ async def score(state: TaskState, target: Target):
168168
name="ifbench_multiturn",
169169
prompt_function=ifbench_prompt,
170170
hf_repo="allenai/IFBench_multi-turn",
171-
hf_subset="default",
171+
hf_subset="ifbench_constraints",
172172
metrics=[ifbench_metrics],
173173
hf_avail_splits=["test"],
174174
evaluation_splits=["test"],

0 commit comments

Comments
 (0)