I am trying to get OpenSearch to work with deploying Machine Learning Models but am running into a connection issue from the JVM that runs opensearch, when it trys download any libraries from the djl site it gives an SSL error. I can wget any files needed to the server and place them where they nee…

Hi @shorrocka - This might be of some help - Connecting to externally hosted models - OpenSearch Documentation - it sounds like you’re trying to pull an externally hosted model. There’s some configuration options that have to be set first, in particular a set of trusted endpoints. Let me know if t…

[image] How can we deploy ML model (.zip) to nodes locally, not via SSL or the firewall OpenSearch Versions (relevant - OpenSearch/Dashboard/Server OS/Browser): 2.15.0 (both OpenSearch and its Dashboards) Kubernetes 1.25.6 Controlled by OpenSearch Operator (2.5.1) Descr…

I followed those steps and they got us almost all the way to where we need to be! Thank you for leading the way!

Awesome, @yeonghyeonKo ! Would you mind creating a PR in ml-commons with a step-by-step development guide that includes detailed instructions? The community would benefit immensely from this.

Sure! @dhrubo I hope it will help others who are not familiar with the same issue. Have you read my comment that detours Firewall issues by pre-downloading pytorch and tokenizers folders and copying them to the opensearch/data/ml_cache path in a ML Node? (and then defining a docker image for new p…

What is the directory that is storing the JniLib files?

Plugins Machine Learning

yeonghyeonKo March 27, 2025, 7:10am 3

I faced the similar issue because of Air-gapped enviromemt. See the above link

Topic		Replies	Views
Offline deployment of pretrained ML models in OpenSearch 2.18.0 — resolving DJL JNI library loading failure Machine Learning troubleshoot , configure	2	147	October 4, 2025
How can we deploy ML model (.zip) to nodes locally, not via SSL or the firewall OpenSearch discuss , troubleshoot , configure , install	8	817	August 19, 2024
Model deployment failure with ml-commons plugin in internet disabled environment Machine Learning discuss , troubleshoot , configure , install	2	1397	September 13, 2023
Offline deployment pretrained of models Machine Learning	2	712	July 25, 2024
Errors when deploy ML Models to Opensearch cluster OpenSearch	1	409	July 24, 2024

What is the directory that is storing the JniLib files?

Related topics