Multi node docker setup not working

Govind12 · September 2, 2024, 12:14pm

Hi everyone ,

I want to setup the opensearch cluster using the 3 machines which are on same network , i want 3 master nodes , 3 data nodes and 3 client nodes , how to do this setup for my UAT/ production environment .

here are the files i created below , what customization should i do for the required setup : -
version: ‘3’
services:
opensearch-master1:
image: opensearchproject/opensearch:latest
container_name: opensearch-master1
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-master1
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- cluster.initial_cluster_manager_nodes=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}

ulimits:
  memlock:
    soft: -1
    hard: -1
  nofile:
    soft: 65536
    hard: 65536
volumes:
  - opensearch_opensearch-master-data1:/usr/share/opensearch/data
    #- ./certs:/usr/share/opensearch/config/certs
ports:
  - 9201:9200
  - 9601:9600
networks:
  - opensearch-net

opensearch-master2:
image: opensearchproject/opensearch:latest
container_name: opensearch-master2
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-master2
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- cluster.initial_cluster_manager_nodes=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
volumes:
- opensearch_opensearch-master-data2:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9202:9200
- 9602:9600
networks:
- opensearch-net

opensearch-master3:
image: opensearchproject/opensearch:latest
container_name: opensearch-master3
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-master3
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- cluster.initial_cluster_manager_nodes=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
volumes:
- opensearch_opensearch-master-data3:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9203:9200
- 9603:9600
networks:
- opensearch-net

Data Nodes

opensearch-data1:
image: opensearchproject/opensearch:latest
container_name: opensearch-data1
environment:
#- OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-data1
- node.roles=data
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true”
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
volumes:
- opensearch_opensearch-data1:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9204:9200
- 9604:9600
networks:
- opensearch-net

opensearch-data2:
image: opensearchproject/opensearch:latest
container_name: opensearch-data2
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-data2
- node.roles=data
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true”
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
volumes:
- opensearch_opensearch-data2:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9205:9200
- 9605:9600
networks:
- opensearch-net

opensearch-data3:
image: opensearchproject/opensearch:latest
container_name: opensearch-data3
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-data3
- node.roles=data
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true”
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
volumes:
- opensearch_opensearch-data3:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9206:9200
- 9606:9600
networks:
- opensearch-net

opensearch-client1:
image: opensearchproject/opensearch:latest
container_name: opensearch-client1
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-client1
- node.roles=ingest,remote_cluster_client
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- cluster.initial_cluster_manager_nodes=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
# volumes:
# - opensearch-client-data1:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
# - ./opensearch-config/opensearch-client.yml:/usr/share/opensearch/config/opensearch.yml
ports:
- 9207:9200
- 9607:9600
networks:
- opensearch-net

opensearch-client2:
image: opensearchproject/opensearch:latest
container_name: opensearch-client2
environment:
# - OPENSEARCH_SECURITY_ADMIN_PASSWORD=@Mine1623
- cluster.name=opensearch-cluster
- node.name=opensearch-client2
- node.roles=ingest,remote_cluster_client
- discovery.seed_hosts=opensearch-master1,opensearch-master2,opensearch-master3
- cluster.initial_cluster_manager_nodes=opensearch-master1,opensearch-master2,opensearch-master3
- bootstrap.memory_lock=true
- “OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m”
- “DISABLE_INSTALL_DEMO_CONFIG=true”
- “DISABLE_SECURITY_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
# volumes:
# - opensearch-client-data2:/usr/share/opensearch/data
# - ./certs:/usr/share/opensearch/config/certs
ports:
- 9208:9200
- 9608:9600
networks:
- opensearch-net

opensearch-dashboards:
image: opensearchproject/opensearch-dashboards:latest
container_name: opensearch-dashboards
environment:
# - OPENSEARCH_PASSWORD=@Mine1623
- ‘OPENSEARCH_HOSTS=[“http://opensearch-master1:9200”,“http://opensearch-master2:9200”,“http://opensearch-master3:9200”]’
- “DISABLE_SECURITY_DASHBOARDS_PLUGIN=true” # Disable security plugin
- OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
ports:
- 5601:5601
networks:
- opensearch-net
#environment:
#- OPENSEARCH_SECURITY_ADMIN_PASSWORD=@VMware12

volumes:
opensearch_opensearch-master-data1:
opensearch_opensearch-master-data2:
opensearch_opensearch-master-data3:
opensearch_opensearch-data1:
opensearch_opensearch-data2:
opensearch_opensearch-data3:

opensearch-client-data1:

#opensearch-client-data2:

networks:
opensearch-net:

same files for other 2 machines

Topic		Replies	Views
Opensearch with multiple nodes on different servers not working OpenSearch troubleshoot	16	10340	September 3, 2024
How to do Multinode opensearch setup using docker compose by multiple machines : OpenSearch discuss , configure , install	7	200	September 4, 2024
Opensearch install error (docker) OpenSearch install	1	593	September 22, 2022
Opensearch Deployment Docker compose in multiple node in different machine IP OpenSearch community-meeting , troubleshoot , install	3	1067	January 22, 2024
Installation instructions for Production - Need Clarity General Feedback	1	1266	August 20, 2021

Multi node docker setup not working

Data Nodes

opensearch-client-data1:

Related topics