Skip to content

Commit 0bceaee

Browse files
ADD GPT-4 as Judge (#206)
* ADD GPT-4 as Judge * Fix style --------- Co-authored-by: Clémentine Fourrier <[email protected]>
1 parent 3a80833 commit 0bceaee

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/lighteval/metrics/metrics_sample.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -622,7 +622,7 @@ def edit_similarity(self, s1, s2):
622622

623623

624624
class JudgeLLM:
625-
available_models = ["gpt-3.5-turbo"]
625+
available_models = ["gpt-3.5-turbo", "gpt-4o", "gpt-4-turbo", "gpt-4"]
626626

627627
def __init__(self, judge_model_name: str, template_path: str, multi_turn: bool = False):
628628
if judge_model_name not in self.available_models:

0 commit comments

Comments
 (0)