Opensearch blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized]

I am trying to setup TLS with wildcard certificate. Nodes are starting up but SERVICE_UNAVAILABLE error is showing up in logs. i get “OpenSearch Security not initialized.” error if i try to access service.
Kindly help me in understanding what is going wrong. Attaching opensearch.yml and logs.

[2021-10-26T07:35:52,794][INFO ][o.o.e.NodeEnvironment    ] [opensearch-cluster-master-2] using [1] data paths, mounts [[/usr/share/opensearch/data (/dev/sdc)]], net usable_space [29.3gb], net total_space [29.4gb], types [ext4]
[2021-10-26T07:35:52,794][INFO ][o.o.e.NodeEnvironment    ] [opensearch-cluster-master-2] heap size [2gb], compressed ordinary object pointers [true]
[2021-10-26T07:35:52,800][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,802][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,802][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,802][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,803][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,869][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,869][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,870][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,870][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:52,871][INFO ][o.o.n.Node               ] [opensearch-cluster-master-2] node name [opensearch-cluster-master-2], node ID [ECa3xWCTRmuiZQQVqlQcqw], cluster name [opensearch-cluster], roles [master, remote_cluster_client, data, ingest]
[2021-10-26T07:35:54,315][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [discovery.zen.ping.unicast.hosts] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,316][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [discovery.zen.minimum_master_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,316][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,316][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,317][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,317][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,452][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:54,470][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,093][WARN ][o.o.s.c.Salt             ] [opensearch-cluster-master-2] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2021-10-26T07:35:55,111][INFO ][o.o.s.a.i.AuditLogImpl   ] [opensearch-cluster-master-2] Message routing enabled: true
[2021-10-26T07:35:55,148][INFO ][o.o.s.f.SecurityFilter   ] [opensearch-cluster-master-2] <NONE> indices are made immutable.
[2021-10-26T07:35:55,313][INFO ][o.o.a.b.ADCircuitBreakerService] [opensearch-cluster-master-2] Registered memory breaker.
[2021-10-26T07:35:55,580][INFO ][o.o.t.NettyAllocator     ] [opensearch-cluster-master-2] creating NettyAllocator with the following configs: [name=opensearch_configured, chunk_size=256kb, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_netty_default_chunk_and_page_size=false, g1gc_enabled=true, g1gc_region_size=1mb}]
[2021-10-26T07:35:55,583][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,585][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,599][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,600][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,600][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,600][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,600][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,605][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,605][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,615][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,615][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,615][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,615][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,615][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,616][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,616][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,616][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,619][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,621][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,621][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,621][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,621][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,625][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,628][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [discovery.zen.ping.unicast.hosts] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,645][INFO ][o.o.d.DiscoveryModule    ] [opensearch-cluster-master-2] using discovery type [zen] and seed hosts providers [settings]
[2021-10-26T07:35:55,655][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,911][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,913][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,913][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,914][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,914][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:55,920][WARN ][o.o.g.DanglingIndicesState] [opensearch-cluster-master-2] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2021-10-26T07:35:56,042][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,154][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [opensearch-cluster-master-2] PerformanceAnalyzer Enabled: false
[2021-10-26T07:35:56,195][INFO ][o.o.n.Node               ] [opensearch-cluster-master-2] initialized
[2021-10-26T07:35:56,195][INFO ][o.o.n.Node               ] [opensearch-cluster-master-2] starting ...
[2021-10-26T07:35:56,200][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,200][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,201][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,201][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,203][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,276][INFO ][o.o.t.TransportService   ] [opensearch-cluster-master-2] publish_address {10.244.3.48:9300}, bound_addresses {[::]:9300}
[2021-10-26T07:35:56,276][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,276][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,276][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,276][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,279][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,279][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,279][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,279][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,279][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,310][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,430][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.data] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,430][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.remote_cluster_client] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,430][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.ingest] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,430][DEPRECATION][o.o.d.c.s.Settings       ] [opensearch-cluster-master-2] [node.master] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2021-10-26T07:35:56,458][INFO ][o.o.b.BootstrapChecks    ] [opensearch-cluster-master-2] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2021-10-26T07:36:06,469][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:16,471][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:26,473][WARN ][o.o.n.Node               ] [opensearch-cluster-master-2] timed out while waiting for initial discovery state - timeout: 30s
[2021-10-26T07:36:26,473][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}, {opensearch-cluster-master-0}{qlfGRqLcT1WB5pnPT5Ck3g}{cQkFwfz1QueCFNZD3tBndQ}{10.244.3.49}{10.244.3.49:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:26,482][INFO ][o.o.h.AbstractHttpServerTransport] [opensearch-cluster-master-2] publish_address {10.244.3.48:9200}, bound_addresses {[::]:9200}
[2021-10-26T07:36:26,482][INFO ][o.o.n.Node               ] [opensearch-cluster-master-2] started
[2021-10-26T07:36:26,483][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-cluster-master-2] Node started
[2021-10-26T07:36:26,483][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-cluster-master-2] Will attempt to create index .opendistro_security and default configs if they are absent
[2021-10-26T07:36:26,483][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-cluster-master-2] Background init thread started. Install default config?: true
[2021-10-26T07:36:26,484][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-cluster-master-2] 0 OpenSearch Security modules loaded so far: []
[2021-10-26T07:36:36,475][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}, {opensearch-cluster-master-0}{qlfGRqLcT1WB5pnPT5Ck3g}{cQkFwfz1QueCFNZD3tBndQ}{10.244.3.49}{10.244.3.49:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:46,477][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}, {opensearch-cluster-master-0}{qlfGRqLcT1WB5pnPT5Ck3g}{cQkFwfz1QueCFNZD3tBndQ}{10.244.3.49}{10.244.3.49:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:56,479][WARN ][o.o.c.c.ClusterFormationFailureHelper] [opensearch-cluster-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}, {opensearch-cluster-master-1}{JANj4n4-RDelOxG68hAlsg}{1mPVk6xxSYyFtEQ28z-Rmw}{10.244.0.83}{10.244.0.83:9300}{dimr}, {opensearch-cluster-master-0}{qlfGRqLcT1WB5pnPT5Ck3g}{cQkFwfz1QueCFNZD3tBndQ}{10.244.3.49}{10.244.3.49:9300}{dimr}]; discovery will continue using [10.244.0.83:9300] from hosts providers and [{opensearch-cluster-master-2}{ECa3xWCTRmuiZQQVqlQcqw}{KXPzQ2xvR8iAe94JtPjSrQ}{10.244.3.48}{10.244.3.48:9300}{dimr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2021-10-26T07:36:56,489][ERROR][o.o.s.c.ConfigurationRepository] [opensearch-cluster-master-2] Cannot apply default config (this is maybe not an error!)
org.opensearch.discovery.MasterNotDiscoveredException: null
	at org.opensearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction$2.onTimeout(TransportMasterNodeAction.java:243) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:348) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:265) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:614) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:697) ~[opensearch-1.0.0.jar:1.0.0]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) ~[?:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
[2021-10-26T07:36:56,496][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [opensearch-cluster-master-2] Exception while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, AUDIT] (index=.opendistro_security)
org.opensearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
	at org.opensearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:203) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:189) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.action.get.TransportMultiGetAction.doExecute(TransportMultiGetAction.java:72) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.action.get.TransportMultiGetAction.doExecute(TransportMultiGetAction.java:53) ~[opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:192) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.indexmanagement.rollup.actionfilter.FieldCapsFilter.apply(FieldCapsFilter.kt:141) [opensearch-index-management-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:190) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.performanceanalyzer.action.PerformanceAnalyzerActionFilter.apply(PerformanceAnalyzerActionFilter.java:99) [opensearch-performance-analyzer-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:190) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.security.filter.SecurityFilter.apply0(SecurityFilter.java:234) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.filter.SecurityFilter.apply(SecurityFilter.java:154) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:190) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:168) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:96) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.client.node.NodeClient.executeLocally(NodeClient.java:99) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.client.node.NodeClient.doExecute(NodeClient.java:88) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.client.support.AbstractClient.execute(AbstractClient.java:428) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.client.support.AbstractClient.multiGet(AbstractClient.java:546) [opensearch-1.0.0.jar:1.0.0]
	at org.opensearch.security.configuration.ConfigurationLoaderSecurity7.loadAsync(ConfigurationLoaderSecurity7.java:211) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.configuration.ConfigurationLoaderSecurity7.load(ConfigurationLoaderSecurity7.java:102) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.configuration.ConfigurationRepository.getConfigurationsFromIndex(ConfigurationRepository.java:375) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.configuration.ConfigurationRepository.reloadConfiguration0(ConfigurationRepository.java:321) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.configuration.ConfigurationRepository.reloadConfiguration(ConfigurationRepository.java:306) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at org.opensearch.security.configuration.ConfigurationRepository$1.run(ConfigurationRepository.java:166) [opensearch-security-1.0.0.0.jar:1.0.0.0]
	at java.lang.Thread.run(Thread.java:832) [?:?]

cluster.name: opensearch-cluster
network.host: 0.0.0.0
plugins:
security:
allow_default_init_securityindex: true
allow_unsafe_democertificates: true
audit.type: internal_opensearch
authcz:
admin_dn:
- C=de,L=test,O=client,OU=client,CN=kirk
check_snapshot_restore_write_privileges: true
enable_snapshot_restore_privilege: true
nodes_dn:
- CN=.az.xyz.com,OU=Domain Control Validated
restapi:
roles_enabled:
- all_access
- security_rest_api_access
ssl:
http:
clientauth_mode: OPTIONAL
enabled: true
pemcert_filepath: /usr/share/opensearch/config/certs/az.xyz.com.crt
pemkey_filepath: /usr/share/opensearch/config/certs/az.xyz-pkcs8.key
pemtrustedcas_filepath: /usr/share/opensearch/config/certs/gd_bundle-g2-g1.crt
transport:
enforce_hostname_verification: false
pemcert_filepath: /usr/share/opensearch/config/certs/az.xyz.com.crt
pemkey_filepath: /usr/share/opensearch/config/certs/az.xyz-pkcs8.key
pemtrustedcas_filepath: /usr/share/opensearch/config/certs/gd_bundle-g2-g1.crt
resolve_hostname: false
system_indices:
enabled: true
indices:
- .opendistro-alerting-config
- .opendistro-alerting-alert

- .opendistro-anomaly-results*
- .opendistro-anomaly-detector*
- .opendistro-anomaly-checkpoints
- .opendistro-anomaly-detection-state
- .opendistro-reports-*
- .opendistro-notifications-*
- .opendistro-notebooks
- .opendistro-asynchronous-search-response*

@sharath_90
Can you repost the opensearch.yml as code block.

Also, Is the below the full DN of nodes:

CN= *.az.xyz.com,OU=Domain Control Validated*

Also, your admin_dn, should be in reversed order:

'CN=kirk,OU=client,O=client,L=test, C=de'

For security reasons, i can not disclose full CN.
It is wildcard certificate and above is equivalent to DN of the same.

@sharath_90 but is the full DN listed under nodes_dn? (“CN=, OU=, O=, L=, C=”)
And can you verify the cert using provided CA?

Also, can you repost the opensearch.yml in script tags please.