Circuit breaker failure on master pods

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
OS - 2.10.0

Describe the issue:
We have a multi node cluster (3 master, 12 data nodes), Getting the CG error on the master pods frequently, the heap size initially was 8GB then i have increased it to 16GB. even after that i got a circuit breaker issue, now i have increased it to 31GB.

below is my index setting,

{
“device-2024-02-28”: {
“settings”: {
“index”: {
“replication”: {
“type”: “DOCUMENT”
},
“number_of_shards”: “5”,
“provided_name”: “device-2024-02-28”,
“creation_date”: “1708996566569”,
“number_of_replicas”: “2”,
“uuid”: “sxbGsk4BQfKoOMPQex5Xyg”,
“version”: {
“created”: “136317827”
}
}
}
}
}

and i want to restrict the expensive running query on the cluster. i did not set any max_result_window value. hope it picks the default

"index.max_result_window": 1000

what should i do to resolve GC issue permanently.

Hi @pablo any advice on this