OpenSearch - High Memory usage / Circuit Breaker Exceptions

OpenSearch
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser): OpenSearch 2.11

Describe the issue:

In my case, my cluster started triggering numerous circuit breaker exception alerts.

More informations about my cluster/operation:

In this case where the circuit_breaker occurred the document size was 3.57 KB. I have some documents bigger than this, but i dont think the average are “too big”.

In this case where the circuit_breaker error occurred, the document contained neither nested nor parent-child.

In my system we have several bulk requests, I also wouldn’t know how big these requests are and how many are occurring at the same time.

Configuration:

6 Nodes with this current configuration showed in the image below

Relevant Logs or Screenshots:

image
image628×850 138 KB

Despite my limited experience with Elastic, I truly believe that the reason the cluster are triggering so many circuit_breaker requests has more to do with how I’m using Elastic than with my cluster’s configuration, which I think is “normal/good.”

I think the biggest problem is that Elastic is the single source of truth for my entire system. I don’t think Elastic is designed for that. This means I have thousands of read/write operations occurring simultaneously. Do you agree with this?

Thanks for all!

2

Hey @aidevelop46 ,

Looking at what you provided it looks that you’re using Elasticsearch? Could you confirm this? Ram usage being high might indicate that additional ram is required especially if you’re seeing issues with circuit_breaker or high heap usage.

However it is hard to say much without first knowing more about the issue, so I first would like to ask a few questions.

Leeroy.