Opensearch Dashboard returns a proxy error if a query exceeded 60 seconds

Hi, my Opensearch Dashboard returns a proxy error if a query exceeded 60 seconds. This only happens in the Opensearch Dashboard UI. If I curl the client or master service directly, all works fine.


Below is the full error message

Wrapper@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:4249
_createSuperInternal@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:3388
HttpFetchError@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:6016
_callee3$@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:59862
tryCatch@https://opensearch.example.com/3032/bundles/plugin/queryWorkbenchDashboards/queryWorkbenchDashboards.plugin.js:1:30543
invoke@https://opensearch.example.com/3032/bundles/plugin/queryWorkbenchDashboards/queryWorkbenchDashboards.plugin.js:1:34502
defineIteratorMethods/</<@https://opensearch.example.com/3032/bundles/plugin/queryWorkbenchDashboards/queryWorkbenchDashboards.plugin.js:1:31682
fetch_asyncGeneratorStep@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:52965
_next@https://opensearch.example.com/3032/bundles/core/core.entry.js:6:53305

Opensearch dashboards version

# cat Chart.yaml 
apiVersion: v2
appVersion: 1.3.2
description: A Helm chart for OpenSearch Dashboards
maintainers:
- name: DandyDeveloper
- name: bbarani
- name: gaiksaya
- name: peterzhuamazon
- name: prudhvigodithi
- name: TheAlgo
name: opensearch-dashboards
type: application
version: 1.5.1

The error message found in the opensearch-dashboards pod

{"type":"log","@timestamp":"2022-06-05T22:34:25Z","tags":["error","opensearch","data"],"pid":1,"message":"[RequestAbortedError]: Request aborted"}

In values.yaml, I set the timeout like below. Please point out if I did anything wrong. Thank you

config:
  opensearch_dashboards.yml: |
    opensearch.requestTimeout: 60000000
    opensearch.shardTimeout: 60000000

I use traefik to manage the network, and found this error in the traefik pod

10.42.1.97 - - [05/Jun/2022:22:33:25 +0000] "POST /internal/search/opensearch HTTP/1.1" 499 21 "-" "-" 87690050 "opensearch-dashboards-2a133ee4f634e303c1ae@kubernetescrd" "http://10.42.1.101:5601" 60056ms