Slow query performance issue

Hi, I am moving from Elasitcsearch 7.13.4 to Opensearch 1.3.2. However, my Opensearch cluster is experiencing a slow query performance issue compared to the Elasticsearch cluster running in the same Kubernetes cluster. I have been sending the same syslog data to both Opensearch and Elasticsearch cluster for some weeks. It takes longer for Opensearch to return a result(Opensearch takes 26s, and Elasticsearch takes 0.3s). Do you have any suggestions for performance tunning? Thank you

[root@k3s-1 ~]# time curl -u $username:$password -sk https://10.43.80.73:9200/*syslog*/_search -H 'Content-Type: application/json' -d '{
  "size": 1000,
  "sort": [
    {
      "timestamp": {
        "order": "desc",
        "unmapped_type": "boolean"
      }
    }
  ],
  "stored_fields": [
    "*"
  ],
  "docvalue_fields": [
    {
      "field": "@timestamp",
      "format": "date_time"
    },
    {
      "field": "timestamp",
      "format": "date_time"
    }
  ],
  "query": {
    "bool": {
      "filter": [
        {
          "match_all": {}
        },
        {
          "range": {
            "timestamp": {
              "gte": "2022-05-22T20:53:54.323Z",
              "lte": "2022-06-05T20:53:54.323Z",
              "format": "strict_date_optional_time"
            }
          }
        }
      ]
    }
  }
}' | jq . >/tmp/es-syslog

real	0m0.368s
user	0m0.047s
sys	0m0.012s

[root@k3s-1 ~]# time curl -u $username:$password -sk https://10.43.218.222:9200/*syslog*/_search -H 'Content-Type: application/json' -d '{
  "size": 1000,
  "sort": [
    {
      "timestamp": {
        "order": "desc",
        "unmapped_type": "boolean"
      }
    }
  ],
  "stored_fields": [
    "*"
  ],
  "docvalue_fields": [
    {
      "field": "@timestamp",
      "format": "date_time"
    },
    {
      "field": "timestamp",
      "format": "date_time"
    }
  ],
  "query": {
    "bool": {
      "filter": [
        {
          "match_all": {}
        },
        {
          "range": {
            "timestamp": {
              "gte": "2022-05-22T20:53:54.323Z",
              "lte": "2022-06-05T20:53:54.323Z",
              "format": "strict_date_optional_time"
            }
          }
        }
      ]
    }
  }
}' | jq . >/tmp/os-syslog

real	0m26.110s
user	0m0.048s
sys	0m0.010s

[root@k3s-1 ~]# du -sh /tmp/*s-syslog
304K	/tmp/es-syslog
304K	/tmp/os-syslog
[root@k3s-1 ~]# kubectl get svc -A |grep 10.43.80.73
elasticsearch     elasticsearch-http                               ClusterIP      10.43.80.73     <none>                                                    9200/TCP                                                                  217d
[root@k3s-1 ~]# kubectl get svc -A |grep 10.43.218.222
opensearch     opensearch-master                             ClusterIP      10.43.218.222   <none>                                                    9200/TCP,9300/TCP                                                         18d
[root@k3s-1 ~]# 

My Opensearch is deployed using the opensearch-1.11.1 chart.

[root@k3s-1 ~]# helm list -n opensearch
NAME                    	NAMESPACE    	REVISION	UPDATED                                	STATUS  	CHART                      	APP VERSION
opensearch-client       	opensearch	3       	2022-06-01 22:30:26.839203084 -0700 PDT	deployed	opensearch-1.11.1          	1.3.2      
opensearch-data         	opensearch	3       	2022-06-01 22:30:33.988830534 -0700 PDT	deployed	opensearch-1.11.1          	1.3.2      
opensearch-master       	opensearch	4       	2022-06-01 22:28:06.608649694 -0700 PDT	deployed	opensearch-1.11.1          	1.3.2      
opensearch-dashboards	opensearch	4       	2022-06-05 13:53:16.781221079 -0700 PDT	deployed	dashboards-1.5.1	1.3.2      
[root@k3s-1 ~]# 

Like my Elasticsearch cluster, it has 8 data nodes, 3 master nodes and 2 clients, but bigger heap size(6G for Openseach Data nodes, 4G for Elasticsearch Data nodes)

# Opensearch JVM configuration
[root@k3s-1 ~]# curl -u $username:$password -sk https://10.43.218.222:9200/_nodes/_all/jvm | jq .
{
  "_nodes": {
    "total": 13,
    "successful": 13,
    "failed": 0
  },
  "cluster_name": "opensearch",
  "nodes": {
    "VmM7HkY2Ru-ttAM8AUBJag": {
      "name": "opensearch-client-1",
      "transport_address": "10.42.3.228:9300",
      "host": "10.42.3.228",
      "ip": "10.42.3.228",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "ingest"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 129,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147848459,
        "mem": {
          "heap_init_in_bytes": 4294967296,
          "heap_max_in_bytes": 4294967296,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-9134609344391643476",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx4G",
          "-Xms4G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=2147483648",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "i64sSckCQS63f8Vnrz9hjw": {
      "name": "opensearch-data-4",
      "transport_address": "10.42.5.238:9300",
      "host": "10.42.5.238",
      "ip": "10.42.5.238",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 130,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147884253,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-7566912590568961428",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },

    "eVnJzH8mRjyk2j2e0uJ_aQ": {
      "name": "opensearch-data-1",
      "transport_address": "10.42.3.229:9300",
      "host": "10.42.3.229",
      "ip": "10.42.3.229",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 125,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147930215,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-4160313430460082222",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "gP5stZkzRZKpzFnQwC0UDg": {
      "name": "opensearch-data-0",
      "transport_address": "10.42.10.90:9300",
      "host": "10.42.10.90",
      "ip": "10.42.10.90",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 128,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147940600,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-2401278837139651339",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "eFRzGxPbT6i-MFx4pcfQZg": {
      "name": "opensearch-master-0",
      "transport_address": "10.42.10.88:9300",
      "host": "10.42.10.88",
      "ip": "10.42.10.88",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "master"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 127,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147737041,
        "mem": {
          "heap_init_in_bytes": 4294967296,
          "heap_max_in_bytes": 4294967296,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-18143413168129157225",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx4G",
          "-Xms4G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=2147483648",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },

    "zf58fpOyRr2JblXUQtaEaQ": {
      "name": "opensearch-data-6",
      "transport_address": "10.42.7.162:9300",
      "host": "10.42.7.162",
      "ip": "10.42.7.162",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 132,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147861215,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-4945139372698676648",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "KdOcsgdSTBCPhYTZPLw4Vg": {
      "name": "opensearch-client-0",
      "transport_address": "10.42.10.89:9300",
      "host": "10.42.10.89",
      "ip": "10.42.10.89",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "ingest"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 135,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147860058,
        "mem": {
          "heap_init_in_bytes": 4294967296,
          "heap_max_in_bytes": 4294967296,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-7094661206726421807",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx4G",
          "-Xms4G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=2147483648",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "yWnsvjRFTXWOzUCDJvdMIw": {
      "name": "opensearch-master-2",
      "transport_address": "10.42.8.229:9300",
      "host": "10.42.8.229",
      "ip": "10.42.8.229",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "master"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 131,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147705365,
        "mem": {
          "heap_init_in_bytes": 4294967296,
          "heap_max_in_bytes": 4294967296,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-14434264116468835799",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx4G",
          "-Xms4G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=2147483648",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "XnMQVF8jRXqRl4O_r9gRUw": {
      "name": "opensearch-data-7",
      "transport_address": "10.42.9.167:9300",
      "host": "10.42.9.167",
      "ip": "10.42.9.167",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 129,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147853945,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-7040909685000132879",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "GGuU-uEhTP6_nek4O6iCWg": {
      "name": "opensearch-data-5",
      "transport_address": "10.42.6.86:9300",
      "host": "10.42.6.86",
      "ip": "10.42.6.86",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 130,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654158223907,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-12251988097308684762",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "UcYr5uEBQRqcRk75QtdGJQ": {
      "name": "opensearch-master-1",
      "transport_address": "10.42.3.227:9300",
      "host": "10.42.3.227",
      "ip": "10.42.3.227",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "master"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 127,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147721778,
        "mem": {
          "heap_init_in_bytes": 4294967296,
          "heap_max_in_bytes": 4294967296,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-1841330876957653590",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx4G",
          "-Xms4G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=2147483648",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "0dw_Kx19S7WYsa3XkvLC6Q": {
      "name": "opensearch-data-3",
      "transport_address": "10.42.4.189:9300",
      "host": "10.42.4.189",
      "ip": "10.42.4.189",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 128,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147894019,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-10078783294544779684",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    },
    "ASZqaxEZQEm9eyt5DsUvKQ": {
      "name": "opensearch-data-2",
      "transport_address": "10.42.8.230:9300",
      "host": "10.42.8.230",
      "ip": "10.42.8.230",
      "version": "1.3.2",
      "build_type": "tar",
      "build_hash": "6febcf7b53ff189de767e460e905e9e5aeecc8cb",
      "roles": [
        "data"
      ],
      "attributes": {
        "shard_indexing_pressure_enabled": "true"
      },
      "jvm": {
        "pid": 125,
        "version": "11.0.15",
        "vm_name": "OpenJDK 64-Bit Server VM",
        "vm_version": "11.0.15+10",
        "vm_vendor": "Eclipse Adoptium",
        "bundled_jdk": true,
        "using_bundled_jdk": true,
        "start_time_in_millis": 1654147910738,
        "mem": {
          "heap_init_in_bytes": 6442450944,
          "heap_max_in_bytes": 6442450944,
          "non_heap_init_in_bytes": 7667712,
          "non_heap_max_in_bytes": 0,
          "direct_max_in_bytes": 0
        },
        "gc_collectors": [
          "G1 Young Generation",
          "G1 Old Generation"
        ],
        "memory_pools": [
          "CodeHeap 'non-nmethods'",
          "Metaspace",
          "CodeHeap 'profiled nmethods'",
          "Compressed Class Space",
          "G1 Eden Space",
          "G1 Old Gen",
          "G1 Survivor Space",
          "CodeHeap 'non-profiled nmethods'"
        ],
        "using_compressed_ordinary_object_pointers": "true",
        "input_arguments": [
          "-Xshare:auto",
          "-Dopensearch.networkaddress.cache.ttl=60",
          "-Dopensearch.networkaddress.cache.negative.ttl=10",
          "-XX:+AlwaysPreTouch",
          "-Xss1m",
          "-Djava.awt.headless=true",
          "-Dfile.encoding=UTF-8",
          "-Djna.nosys=true",
          "-XX:-OmitStackTraceInFastThrow",
          "-Dio.netty.noUnsafe=true",
          "-Dio.netty.noKeySetOptimization=true",
          "-Dio.netty.recycler.maxCapacityPerThread=0",
          "-Dio.netty.allocator.numDirectArenas=0",
          "-Dlog4j.shutdownHookEnabled=false",
          "-Dlog4j2.disable.jmx=true",
          "-Djava.locale.providers=SPI,COMPAT",
          "-Xms1g",
          "-Xmx1g",
          "-XX:+UseG1GC",
          "-XX:G1ReservePercent=25",
          "-XX:InitiatingHeapOccupancyPercent=30",
          "-Djava.io.tmpdir=/tmp/opensearch-3720998071567621476",
          "-XX:+HeapDumpOnOutOfMemoryError",
          "-XX:HeapDumpPath=data",
          "-XX:ErrorFile=logs/hs_err_pid%p.log",
          "-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m",
          "-Dclk.tck=100",
          "-Djdk.attach.allowAttachSelf=true",
          "-Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy",
          "--add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED",
          "-Dopensearch.cgroups.hierarchy.override=/",
          "-Xmx6G",
          "-Xms6G",
          "-Dopensearch.allow_insecure_settings=true",
          "-XX:MaxDirectMemorySize=3221225472",
          "-Dopensearch.path.home=/usr/share/opensearch",
          "-Dopensearch.path.conf=/usr/share/opensearch/config",
          "-Dopensearch.distribution.type=tar",
          "-Dopensearch.bundled_jdk=true"
        ]
      }
    }
  }
}

Hi @deng47 ,

This is interesting, could you please run your query with profile enabled [1] and share the breakdown? Thank you.

[1] Profile API | Elasticsearch Guide [7.10] | Elastic

@reta

Thank you for your reply. I have deleted my data in OpenSearch, so I can’t compare the performance at this moment. I will start flowing data into Opensearch for a few days, and try enabling the profile. I will put my update here