OpenSearch query response time not consistent

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser): OpenSearch - v 2.11.0

Describe the issue: We are doing performance Test on Opensearch with following configuration
OS - m5.2xlarge
Ram - 32gb
CPU - 8
Using 2 nodes and JVMs -16GB (node 1 - 8GB node -2- 8GB. We are running same query with 30 concurrent users by using JMeter. with zero ramp up time. every time response time changing, we have seen 2 sec differences in two runs. there is not any real-time update on OpenSearch data. please suggest how we can get consistent result.

Configuration:
OS - m5.2xlarge
Ram - 32gb
CPU - 8

Relevant Logs or Screenshots:

If you have 0 ramp up time, the state of your operating system and opensearch-related caches will impact performance by a lot.

You’ll probably want to do a “warming up” run just to keep your caches in a comparable state.

Also, I’d suggest monitoring OpenSearch and checking what happens during your test run. If you don’t have a good monitoring tool, let me shamelessly plug ours :slight_smile: OpenSearch Monitoring Integration