Versions:
OpenSeearch 2.17.1
Debian GNU/Linux 12 (bookworm)
Happens with all browsers
Describe the issue:
When executing queries (boolean/must; nothing too complex) sometimes the server load rises high (up to 18) and then stays there. We can see lots of child processes that never end.
This brings the server down. Only restarting OpenSearch helps.
HINT: This is not during index time, but during query time.
Configuration:
We run a single server installation (12 cores, 48 GB RAM) of OpenSearch. There are several hundred thousand documents in five different indexes. The largest index in size has about 2GB (~20k documents). The largest index in number of documents has ~430k documents.
OpenSearch has been installed via the official package manager.
Relevant Logs or Screenshots:
There are not much logs. The only “unusual” entries seem to be
{"type": "server", "timestamp": "2024-11-07T15:00:20,361+01:00", "level": "ERROR", "component": "o.o.p.c.j.GCMetrics", "cluster.name": "opensearch", "node.name": "nde1", "message": "MX bean missing: G1 Concurrent GC" }
and
{"type": "server", "timestamp": "2024-11-07T15:00:22,967+01:00", "level": "ERROR", "component": "o.o.s.l.BuiltinLogTypeLoader", "cluster.name": "opensearch", "node.name": "nde1", "message": "Failed loading builtin log types from disk!",
during start up.
