Skip to content

Commit 1e3e9ec

Browse files
committed
fix missing TrustRemoteCode in OpenVINO model load
1 parent ac56ac2 commit 1e3e9ec

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

backend/python/transformers/transformers_server.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -149,6 +149,7 @@ def LoadModel(self, request, context):
149149
device_map="CPU"
150150
self.model = OVModelForCausalLM.from_pretrained(model_name,
151151
compile=True,
152+
trust_remote_code=request.TrustRemoteCode,
152153
ov_config={"PERFORMANCE_HINT": "LATENCY"},
153154
device=device_map)
154155
self.OV = True

0 commit comments

Comments
 (0)