Skip to content

Commit 7a4bf2a

Browse files
philschmidclefourrier
authored andcommitted
ADD GPT-4 as Judge (huggingface#206)
* ADD GPT-4 as Judge * Fix style --------- Co-authored-by: Clémentine Fourrier <[email protected]>
1 parent 67b1e0e commit 7a4bf2a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/lighteval/metrics/metrics_sample.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -664,7 +664,7 @@ def edit_similarity(self, s1, s2):
664664

665665

666666
class JudgeLLM:
667-
available_models = ["gpt-3.5-turbo"]
667+
available_models = ["gpt-3.5-turbo", "gpt-4o", "gpt-4-turbo", "gpt-4"]
668668

669669
def __init__(self, judge_model_name: str, template_path: str, multi_turn: bool = False):
670670
if judge_model_name not in self.available_models:

0 commit comments

Comments
 (0)