Skip to content

Commit 5ffe40d

Browse files
authored
fix the location of tasks list in the readme (#267)
1 parent e9b5a0a commit 5ffe40d

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,8 @@ accelerate launch --multi_gpu --num_processes=<num_gpus> -m \
101101
--output_dir output_dir
102102
```
103103

104-
Here, `--tasks` refers to either a _comma-separated_ list of supported tasks from the [metadata table](src/lighteval/tasks/tasks_table.jsonl) in the format:
104+
Here, `--tasks` refers to either a _comma-separated_ list of supported tasks from the [tasks_list](examples/tasks/all_tasks.txt) in the format:
105+
Tasks details can also be found in the [file implementing them](src/lighteval/tasks/default_tasks.py).
105106

106107
```
107108
suite|task|num_few_shot|{0 or 1 to automatically reduce `num_few_shot` if prompt is too long}
@@ -113,7 +114,7 @@ or a file path like [`examples/tasks/recommended_set.txt`](./examples/tasks/reco
113114
accelerate launch --multi_gpu --num_processes=8 -m \
114115
lighteval accelerate \
115116
--model_args "pretrained=gpt2" \
116-
--tasks "lighteval|truthfulqa:mc|0|0" \
117+
--tasks "leaderboard|truthfulqa:mc|0|0" \
117118
--override_batch_size 1 \
118119
--output_dir="./evals/"
119120
```

0 commit comments

Comments
 (0)