We are facing frequent node disconnects with the error message \"master not discovered yet: have discovered \"

We are setting up Opensearch on Bare-metal hosts.

We are facing frequent node disconnects with the error message "master not discovered yet: have discovered "

Below are the exceptions we are seeing in the logs.

#1
[2022-09-22T14:15:26,336][WARN ][o.o.c.c.ClusterFormationFailureHelper] [data1] master not discovered yet: have discovered []; discovery will continue using [] from hosts providers and [**] from last-known cluster state; node term 6, last-accepted version 51 in term 6

#2
[2022-09-19T14:09:45,820][DEBUG][o.o.c.c.LeaderChecker ] [] 1 consecutive failures (limit [cluster.fault_detection.leader_check.retry_count] is 3) with leader []
org.opensearch.transport.RemoteTransportException: [][internal:coordination/fault_detection/leader_check]
Caused by: org.opensearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [
] has been removed from the cluster

#3
[2022-09-19T14:09:46,825][DEBUG][o.o.c.c.LeaderChecker ] [] 2 consecutive failures (limit [cluster.fault_detection.leader_check.retry_count] is 3) with leader []
org.opensearch.transport.RemoteTransportException: [][internal:coordination/fault_detection/leader_check]
Caused by: org.opensearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [
] has been removed from the cluster

#4
[2022-09-19T13:29:00,783][WARN ][o.o.c.c.JoinHelper ] [] last failed join attempt was 5.8s ago, failed to join {} with JoinRequest{sourceNode=, minimumTerm=24, optionalJoin=Optional[Join{term=24, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={shard_indexing_pressure_enabled=true}, targetNode={}
org.opensearch.transport.RemoteTransportException: [
][internal:cluster/coordination/join]
Caused by: org.opensearch.transport.ConnectTransportException: [**] general node connection failure

Thanks,
Mukul

Oh boi there has to be a lot to unfold, can you share your opensearch.yml configuration?
Also note you have to update configuration files (whatever the change) on every master node when working with opensearch as a service type of cluster.