Skip to content

Commit d82d74e

Browse files
authored
Merge branch 'mudler:master' into incl-ocv-pkg-for-diffsusers-utils
2 parents 84e0522 + f718a39 commit d82d74e

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

backend/python/transformers/transformers_server.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -149,6 +149,7 @@ def LoadModel(self, request, context):
149149
device_map="CPU"
150150
self.model = OVModelForCausalLM.from_pretrained(model_name,
151151
compile=True,
152+
trust_remote_code=request.TrustRemoteCode,
152153
ov_config={"PERFORMANCE_HINT": "LATENCY"},
153154
device=device_map)
154155
self.OV = True

0 commit comments

Comments
 (0)