Skip to content

Commit 3093174

Browse files
authored
updates ifeval repo (#268)
* updates ifeval repo * fix task version
1 parent 5ffe40d commit 3093174

File tree

1 file changed

+2
-1
lines changed
  • src/lighteval/tasks/extended/ifeval

1 file changed

+2
-1
lines changed

src/lighteval/tasks/extended/ifeval/main.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,7 +144,7 @@ def agg_inst_level_acc(items):
144144
name="ifeval",
145145
prompt_function=ifeval_prompt,
146146
suite=["extended"],
147-
hf_repo="wis-k/instruction-following-eval",
147+
hf_repo="google/IFEval",
148148
hf_subset="default",
149149
metric=[ifeval_metrics],
150150
hf_avail_splits=["train"],
@@ -153,6 +153,7 @@ def agg_inst_level_acc(items):
153153
few_shots_select="random_sampling",
154154
generation_size=1280,
155155
stop_sequence=[], # no stop sequence, will use eot token
156+
version="0.1",
156157
)
157158

158159

0 commit comments

Comments
 (0)