Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
Opensearch 2.12
Describe the issue:
When I try to do
systemctl reastart opensearch
The start process becames stack in the line (pls see log)
[2024-03-01T21:31:26,882][ERROR][o.o.p.c.j.GCMetrics ] [opensearch-cluster_manager] MX bean missing: G1 Concurrent GC
Configuration:
2024-03-01T21:31:24,990][INFO ][o.o.t.TransportService ] [opensearch-cluster_manager] publish_address {192.168.1.89:9300}, bound_addresses {[::]:9300}
[2024-03-01T21:31:25,074][INFO ][o.o.c.c.Coordinator ] [opensearch-cluster_manager] cluster UUID [uHCMGu-oSLymKqQX1odAmQ]
[2024-03-01T21:31:25,074][ERROR][o.o.b.Bootstrap ] [opensearch-cluster_manager] Exception
java.lang.IllegalStateException: cannot start with [discovery.type] set to [single-node] when local node {opensearch-cluster_manager}{bkQ5a4GVR8GCcJAqfq_ulw}{y4k7wEhuShSYEc8FMAELfA}{192.168.1.89}{192.168.1.89:9300}{dim}{shard_indexing_pressure_enabled=true} does not have quorum in voting configuration VotingConfiguration{aFoj_xR2T96V5AbwsXoIEg}
at org.opensearch.cluster.coordination.Coordinator.doStart(Coordinator.java:851) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.common.lifecycle.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-common-2.12.0.jar:2.12.0]
at org.opensearch.node.Node.start(Node.java:1478) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413) [opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) [opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) [opensearch-2.12.0.jar:2.12.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) [opensearch-2.12.0.jar:2.12.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-2.12.0.jar:2.12.0]
at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) [opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) [opensearch-2.12.0.jar:2.12.0]
[2024-03-01T21:31:25,077][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [opensearch-cluster_manager] uncaught exception in thread [main]
org.opensearch.bootstrap.StartupException: java.lang.IllegalStateException: cannot start with [discovery.type] set to [single-node] when local node {opensearch-cluster_manager}{bkQ5a4GVR8GCcJAqfq_ulw}{y4k7wEhuShSYEc8FMAELfA}{192.168.1.89}{192.168.1.89:9300}{dim}{shard_indexing_pressure_enabled=true} does not have quorum in voting configuration VotingConfiguration{aFoj_xR2T96V5AbwsXoIEg}
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:185) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.12.0.jar:2.12.0]
at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) ~[opensearch-2.12.0.jar:2.12.0]
Caused by: java.lang.IllegalStateException: cannot start with [discovery.type] set to [single-node] when local node {opensearch-cluster_manager}{bkQ5a4GVR8GCcJAqfq_ulw}{y4k7wEhuShSYEc8FMAELfA}{192.168.1.89}{192.168.1.89:9300}{dim}{shard_indexing_pressure_enabled=true} does not have quorum in voting configuration VotingConfiguration{aFoj_xR2T96V5AbwsXoIEg}
at org.opensearch.cluster.coordination.Coordinator.doStart(Coordinator.java:851) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.common.lifecycle.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-common-2.12.0.jar:2.12.0]
at org.opensearch.node.Node.start(Node.java:1478) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413) ~[opensearch-2.12.0.jar:2.12.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) ~[opensearch-2.12.0.jar:2.12.0]
… 6 more
[2024-03-01T21:31:26,882][ERROR][o.o.p.c.j.GCMetrics ] [opensearch-cluster_manager] MX bean missing: G1 Concurrent GC
and config file opensearch.yml
cluster.name: opensearch-cluster
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
#node.name: node-1
node.name: opensearch-cluster_manager
node.roles: ["cluster_manager","data","ingest"]
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /var/lib/opensearch
#
# Path to log files:
#
path.logs: /var/log/opensearch
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# OpenSearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
#network.host: 192.168.0.1
#network.host: 192.168.1.89
network.host: 0.0.0.0
discovery.type: single-node
# Set a custom port for HTTP:
#
#http.port: 9200
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.seed_hosts: ["host1", "host2"]
#discovery.seed_hosts: myhome-masters-0
#cluster.initial_cluster_manager_nodes: myhome-masters-0
#network.bind_host: 192.168.1.89
#
# Bootstrap the cluster using an initial set of cluster-manager-eligible nodes:
#
#cluster.initial_cluster_manager_nodes: ["node-1", "node-2"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
Relevant Logs or Screenshots:
Any comment/advice would be helpful !