# Opensearch-ml TransportError **URL:** \ **Category:** Machine Learning\ **Created:** [February 23, 2023, 1:38pm UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617 "2023-02-23T13:38:09Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![nabs](https://avatars.discourse-cdn.com/v4/letter/n/73ab20/32.png) [@nabs](https://forum.opensearch.org/u/nabs)\ **Post date:** [February 23, 2023, 1:38pm UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617/1 "2023-02-23T13:38:09Z")
**Versions** (relevant - OpenSearch/Dashboard/Server OS/Browser): Macbook pro M1 (13.0 (22A8380) Ventura) ```auto opensearch-dsl 2.0.1 opensearch-py 2.1.1 opensearch-py-ml 1.0.0 ``` **Describe the issue** : I’m trying to follow along with [this](https://opensearch-project.github.io/opensearch-py-ml/examples/demo_ml_commons_integration.html) guide but having trouble at the load model step. ```python load_model_output = ml_client.load_model(model_id) ``` However, the load fails with a resource error: ```auto TransportError Traceback (most recent call last) Cell In[23], line 1 ----> 1 load_model_output = ml_client.load_model(model_id) 2 print(load_model_output) File ~/Desktop/super-search/venv/lib/python3.10/site-packages/opensearch_py_ml/ml_commons/ml_commons_client.py:78, in MLCommonClient.load_model(self, model_id) 67 """ 68 This method loads model into opensearch cluster using ml-common plugin's load model api 69 (...) 73 :rtype: object 74 """ 76 API_URL = f"{ML_BASE_URI}/models/{model_id}/_load" ---> 78 return self._client.transport.perform_request( 79 method="POST", 80 url=API_URL, 81 ) File ~/Desktop/super-search/venv/lib/python3.10/site-packages/opensearchpy/transport.py:408, in Transport.perform_request(self, method, url, headers, params, body) 406 raise e 407 else: --> 408 raise e 410 else: 411 # connection didn't fail, confirm it's live status ... --> 301 raise HTTP_EXCEPTIONS.get(status_code, TransportError)( 302 status_code, error_message, additional_info 303 ) TransportError: TransportError(500, 'm_l_resource_not_found_exception', 'no eligible node found') ``` Am I supposed to have a specific multicpu set up to use the ml-commons portion of the demo? I believe the model upload portion was successful because I can get the model info and status: ![image](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/0/0b748df0356c1a9dede319a2cd1fb87bc2a7a867.png) **Configuration** : Running opensearch cluster with docker: ```auto version: "3" services: opensearch-node: image: opensearchproject/opensearch:latest container_name: opensearch-node environment: - discovery.type=single-node - "DISABLE_INSTALL_DEMO_CONFIG=true" - "DISABLE_SECURITY_PLUGIN=true" ulimits: memlock: soft: -1 hard: -1 ports: - 9200:9200 opensearch-dashboards: image: opensearchproject/opensearch-dashboards:latest container_name: opensearch-dashboards ports: - 5601:5601 expose: - "5601" environment: - "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" - "OPENSEARCH_HOSTS=http://opensearch-node:9200" ``` **Relevant Logs or Screenshots** : ---
**Author:** ![nabs](https://avatars.discourse-cdn.com/v4/letter/n/73ab20/32.png) [@nabs](https://forum.opensearch.org/u/nabs)\ **Post date:** [February 23, 2023, 2:45pm UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617/2 "2023-02-23T14:45:43Z")
realized I didn’t have an ml-node for the cluster so I just disabled the ml-commons plugin from running on an ml only node like so: ```auto version: "3" services: opensearch-node: image: opensearchproject/opensearch:latest container_name: opensearch-node environment: - discovery.type=single-node - "DISABLE_INSTALL_DEMO_CONFIG=true" - "DISABLE_SECURITY_PLUGIN=true" - plugins.ml_commons.only_run_on_ml_node=false ulimits: memlock: soft: -1 hard: -1 ports: - 9200:9200 opensearch-dashboards: image: opensearchproject/opensearch-dashboards:latest container_name: opensearch-dashboards ports: - 5601:5601 expose: - "5601" environment: - "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" - "OPENSEARCH_HOSTS=http://opensearch-node:9200" ``` and now i can load a model! 🙂 ![image](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/6/6629609eb8dabe76444a7227ba9a7eb2f09feca4.png) if someone can advise, what is wrong with this setup below? I was unable to run two nodes (dedicating one for ml specifically) because it seemed the cluster could not allocate a clustermanager, even though I explicitly set it to be `opensearch-node1`. ideas anyone? ```auto version: "3" services: opensearch-node1: image: opensearchproject/opensearch:latest container_name: opensearch-node1 environment: - cluster.name=opensearch-cluster # Name the cluster - discovery.seed_hosts=opensearch-node1,opensearch-ml-node - cluster.initial_cluster_manager_nodes=opensearch-node1 # Nodes eligible to serve as cluster manager - "DISABLE_INSTALL_DEMO_CONFIG=true" - "DISABLE_SECURITY_PLUGIN=true" - bootstrap.memory_lock=true # Disable JVM heap memory swapping - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # Set min and max JVM heap sizes to at least 50% of system RAM ulimits: memlock: soft: -1 hard: -1 ports: - 9200:9200 # REST API - 9600:9600 # Performance Analyzer volumes: - opensearch-data1:/usr/share/opensearch/data # Creates volume called opensearch-data1 and mounts it to the container networks: - opensearch-net # All of the containers will join the same Docker bridge network opensearch-ml-node: image: opensearchproject/opensearch:latest # This should be the same image used for opensearch-node1 to avoid issues container_name: opensearch-ml-node environment: - cluster.name=opensearch-cluster - node.name=opensearch-ml-node - node.roles=[ml] - discovery.seed_hosts=opensearch-node1,opensearch-ml-node - cluster.initial_cluster_manager_nodes=opensearch-node1 - "DISABLE_SECURITY_PLUGIN=true" - bootstrap.memory_lock=true - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # Set min and max JVM heap sizes to at least 50% of system RAM ulimits: memlock: soft: -1 hard: -1 nofile: soft: 65536 hard: 65536 volumes: - opensearch-data2:/usr/share/opensearch/data networks: - opensearch-net volumes: opensearch-data1: opensearch-data2: networks: opensearch-net: ``` ---
**Author:** ![dtaivpp](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/dtaivpp/32/2814_2.png) [@dtaivpp](https://forum.opensearch.org/u/dtaivpp)\ **Post date:** [February 24, 2023, 9:10pm UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617/3 "2023-02-24T21:10:07Z")
Have you tried manually enabling the cluster manager with the following? > **[Creating a cluster](https://opensearch.org/docs/latest/tuning-your-cluster/cluster/#nodes)** > > Creating a cluster ---
**Author:** ![ylwu](https://avatars.discourse-cdn.com/v4/letter/y/a9a28c/32.png) [@ylwu](https://forum.opensearch.org/u/ylwu)\ **Post date:** [March 11, 2023, 1:37am UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617/4 "2023-03-11T01:37:07Z")
@nabs I created a sample `docker-compose.yml` file in this PR [add docker-compose file for starting cluster with dedicated ML node by ylwu-amzn · Pull Request #799 · opensearch-project/ml-commons · GitHub](https://github.com/opensearch-project/ml-commons/pull/799). You can try it Suggest disable native memory circuit breaker as this docker ML node has limited memory. You can also disable it by running this after starting cluster ```auto PUT _cluster/settings { "persistent" : { "plugins.ml_commons.native_memory_threshold" : 100 } } ``` BTW, we published some pre-trained models from 2.6 which may save your effort to trace model [Pretrained models - OpenSearch documentation](https://opensearch.org/docs/latest/ml-commons-plugin/pretrained-models/). If you see any issues, or have any suggestions/feature requirements , please don’t hesitate to tell us. We are glad to provide help. ---
**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/3/33547ea01a5b12dcca2958411d3edd97ae2ea8c1.png) [@system](https://forum.opensearch.org/u/system)\ **Post date:** [May 10, 2023, 1:37am UTC](https://forum.opensearch.org/t/opensearch-ml-transporterror/12617/5 "2023-05-10T01:37:09Z")
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.