How to deploy a Hugging Face model that requires trust_remote_code=True

OpenSearch Client Libraries
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
2.13

Describe the issue:
We have followed this tutorial to deploy different Hugging Face models to OpenSearch without problems:
Demo tracing model torchscript

We would like to use Jina AI’s embedding models in OpenSearch, but they require using the argument trust_remote_code=True when loading the model.
Trust remote code required

Is there a way to deploy to OpenSearch a Hugging Face model that requires the argument “trust_remote_code=True”?

Configuration:
Docker installation with 3 nodes (2xdata+ML)

Relevant Logs or Screenshots:
N/A

2

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.