Opensearch dashboard goes blank with Json parse error

I have a prometheus metrics data exported to opensearch dashboard. once i click any of the metrics exported on the observability->metrics, the dashboard fails to load.

Uncaught (in promise) SyntaxError: "[object Object]" is not valid JSON
    at JSON.parse (<anonymous>)
    at displayVisualization (observabilityDashboards.plugin.js:1633:114610)
    at observabilityDashboards.chunk.4.js:1:411757
    at Object.fa [as useMemo] (osd-ui-shared-deps.js:435:61568)
    at t.useMemo (osd-ui-shared-deps.js:419:5984)
    at VisualizationContainer (observabilityDashboards.chunk.4.js:1:410467)
    at $i (osd-ui-shared-deps.js:435:57931)
    at Na (osd-ui-shared-deps.js:435:66792)
    at gs (osd-ui-shared-deps.js:435:105389)
    at uc (osd-ui-shared-deps.js:435:96718)
displayVisualization @ observabilityDashboards.plugin.js:1633
(anonymous) @ observabilityDashboards.chunk.4.js:1
fa @ osd-ui-shared-deps.js:435
t.useMemo @ osd-ui-shared-deps.js:419
VisualizationContainer @ observabilityDashboards.chunk.4.js:1
$i @ osd-ui-shared-deps.js:435
Na @ osd-ui-shared-deps.js:435
gs @ osd-ui-shared-deps.js:435
uc @ osd-ui-shared-deps.js:435
sc @ osd-ui-shared-deps.js:435
Qs @ osd-ui-shared-deps.js:435
(anonymous) @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
Vo @ osd-ui-shared-deps.js:435
Yo @ osd-ui-shared-deps.js:435
$s @ osd-ui-shared-deps.js:435
ba @ osd-ui-shared-deps.js:435
renderCatalogVisualization @ observabilityDashboards.plugin.js:1633
await in renderCatalogVisualization (async)
loadVisaulization @ observabilityDashboards.chunk.4.js:1
await in loadVisaulization (async)
(anonymous) @ observabilityDashboards.chunk.4.js:1
os @ osd-ui-shared-deps.js:435
gc @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
bc @ osd-ui-shared-deps.js:435
Qs @ osd-ui-shared-deps.js:435
(anonymous) @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
Vo @ osd-ui-shared-deps.js:435
Yo @ osd-ui-shared-deps.js:435
tc @ osd-ui-shared-deps.js:435
jc @ osd-ui-shared-deps.js:435
t.render @ osd-ui-shared-deps.js:435
Observability @ observabilityDashboards.chunk.4.js:1
(anonymous) @ observabilityDashboards.plugin.js:2215
await in (anonymous) (async)
(anonymous) @ core.entry.js:15
mount @ core.entry.js:15
(anonymous) @ core.entry.js:15
os @ osd-ui-shared-deps.js:435
is @ osd-ui-shared-deps.js:435
fc @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
dc @ osd-ui-shared-deps.js:435
Qs @ osd-ui-shared-deps.js:435
(anonymous) @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
Vo @ osd-ui-shared-deps.js:435
Yo @ osd-ui-shared-deps.js:435
$s @ osd-ui-shared-deps.js:435
enqueueSetState @ osd-ui-shared-deps.js:435
v.setState @ osd-ui-shared-deps.js:419
(anonymous) @ osd-ui-shared-deps.js:349
e @ core.entry.js:6
(anonymous) @ core.entry.js:6
notifyListeners @ core.entry.js:6
p @ core.entry.js:6
(anonymous) @ core.entry.js:6
confirmTransitionTo @ core.entry.js:6
push @ core.entry.js:6
navigate @ core.entry.js:15
navigateToApp @ core.entry.js:15
await in navigateToApp (async)
onClick @ core.entry.js:15
s @ osd-ui-shared-deps.js:435
f @ osd-ui-shared-deps.js:435
(anonymous) @ osd-ui-shared-deps.js:435
m @ osd-ui-shared-deps.js:435
at @ osd-ui-shared-deps.js:435
ot @ osd-ui-shared-deps.js:435
st @ osd-ui-shared-deps.js:435
ft @ osd-ui-shared-deps.js:435
D @ osd-ui-shared-deps.js:435
F @ osd-ui-shared-deps.js:435
Jt @ osd-ui-shared-deps.js:435
Zt @ osd-ui-shared-deps.js:435
t.unstable_runWithPriority @ osd-ui-shared-deps.js:443
Xo @ osd-ui-shared-deps.js:435
W @ osd-ui-shared-deps.js:435
Gt @ osd-ui-shared-deps.js:435

has anyone seen this issue. Same is observed on exporting the log data.

Hey @Akshat

What kind of installation is this? Did this error just start happening?

1 Like

This is a fresh installation on our cluster and we did setup security and are able to login to the dashboard.

Hey

This is odd,
I assume you see metric’s coming from Prometheus ? I used Prometheus with OpenSearch and never had Dashboard go blank.

Is there any other logs you can share or is that your only log trace above?

By chance is the Prometheus configuration on the same tenant where its viewed? And does that user have permission ? Only things I can think of beside resources.

1 Like

Hey there,

I have the same / similiar issue:
For test purposes we run a single node cluster. Dasboard and Opensearch running natively (Ubuntu) on the same machine.
I have also setup a dockerized Prometheus accessible via locahost.
Prometheus seems to be running correctly. Metrics can be fetched with curl.

I tried adding the Prometheus datasource via Opensearch API and Dashboard. Both show the same issue:
After adding the new data source I can see all the metrics (Query Explorer). Once I select at least one metric to do queries everything goes blank (besides menu bar, breadcrumbs).
After that every access to https://opensearch.SOME_DOMAIN.de/app/observability-metrics#/ leads to the same “blank” Dashboard. I can re-add the datasource again. Same behaviour.

Webbrowser shows the following errors:

Content-Security-Policy: Die Einstellungen der Seite haben das Laden einer Ressource auf inline blockiert ("script-src"). observability-metrics:366:85544
SyntaxError: JSON.parse: unexpected character at line 1 column 2 of the JSON data
    displayVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    memoisedVisualizationBox https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    fa https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    useMemo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:419
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    $i https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Na https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    uc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    sc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    $s https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    ba https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    renderCatalogVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    loadVisaulization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    bc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Observability https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    appMountWithStartPage https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:2215
    wrapMount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    mount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    AppContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    is https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    fc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    dc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    __osdBootstrap__ https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:166
    innerCb https://opensearch.SOME_DOMAIN.de/bootstrap.js:85
    loadScript https://opensearch.SOME_DOMAIN.de/bootstrap.js:75
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:94
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:81
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:99
    EventHandlerNonNull* https://opensearch.SOME_DOMAIN.de/bootstrap.js:42
osd-ui-shared-deps.js:435:82386
    es https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    callback https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    di https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    is https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    fc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    dc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    $s https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    ba https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    renderCatalogVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    loadVisaulization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    bc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Observability https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    appMountWithStartPage https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:2215
    wrapMount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    mount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    AppContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    is https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    fc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    dc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    __osdBootstrap__ https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:166
    innerCb https://opensearch.SOME_DOMAIN.de/bootstrap.js:85
    (Async: EventListener.handleEvent)
    loadScript https://opensearch.SOME_DOMAIN.de/bootstrap.js:75
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:94
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:81
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:99
    (Async: EventHandlerNonNull)
    <anonym> https://opensearch.SOME_DOMAIN.de/bootstrap.js:42
SyntaxError: JSON.parse: unexpected character at line 1 column 2 of the JSON data
    displayVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    memoisedVisualizationBox https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    fa https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    useMemo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:419
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    $i https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Na https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    uc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    sc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    $s https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    ba https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    renderCatalogVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    loadVisaulization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    bc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Observability https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    appMountWithStartPage https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:2215
    wrapMount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    mount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    AppContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    is https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    fc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    dc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    __osdBootstrap__ https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:166
    innerCb https://opensearch.SOME_DOMAIN.de/bootstrap.js:85
    loadScript https://opensearch.SOME_DOMAIN.de/bootstrap.js:75
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:94
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:81
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:99
    EventHandlerNonNull* https://opensearch.SOME_DOMAIN.de/bootstrap.js:42
osd-ui-shared-deps.js:435:82386
Uncaught (in promise) SyntaxError: JSON.parse: unexpected character at line 1 column 2 of the JSON data
    displayVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    memoisedVisualizationBox https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    fa https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    useMemo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:419
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    $i https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Na https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    uc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    sc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    $s https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    ba https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    renderCatalogVisualization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:1633
    loadVisaulization https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    VisualizationContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    gc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    bc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Observability https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.chunk.4.js:1
    appMountWithStartPage https://opensearch.SOME_DOMAIN.de/7326/bundles/plugin/observabilityDashboards/observabilityDashboards.plugin.js:2215
    wrapMount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    mount https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    AppContainer https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    os https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    is https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    fc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    dc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Qs https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    unstable_runWithPriority https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:443
    Xo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Vo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    Yo https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    tc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    jc https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    render https://opensearch.SOME_DOMAIN.de/7326/bundles/osd-ui-shared-deps/osd-ui-shared-deps.js:435
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    start https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    __osdBootstrap__ https://opensearch.SOME_DOMAIN.de/7326/bundles/core/core.entry.js:15
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:166
    innerCb https://opensearch.SOME_DOMAIN.de/bootstrap.js:85
    loadScript https://opensearch.SOME_DOMAIN.de/bootstrap.js:75
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:94
    load https://opensearch.SOME_DOMAIN.de/bootstrap.js:81
    onload https://opensearch.SOME_DOMAIN.de/bootstrap.js:99
    EventHandlerNonNull* https://opensearch.SOME_DOMAIN.de/bootstrap.js:42
observabilityDashboards.plugin.js:1633:114610

Logs from opensearch-dashboard:

{"type":"response","@timestamp":"2024-03-20T08:30:06Z","tags":[],"pid":124582,"method":"post","statusCode":200,"req":{"url":"/api/ppl/search","method":"post","headers":{"host":"XXX.XXX.XXX.XXX:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:122.0) Gecko/20100101 Firefox/122.0","accept":"*/*","accept-language":"de,en-US;q=0.7,en;q=0.3","accept-encoding":"gzip, deflate, br","referer":"https://XXX.XXX.XXX.XXX:5601/app/observability-metrics","content-type":"application/json","osd-version":"2.12.0","osd-xsrf":"osd-fetch","content-length":"79","origin":"https://XXX.XXX.XXX.XXX:5601","dnt":"1","sec-gpc":"1","connection":"keep-alive","sec-fetch-dest":"empty","sec-fetch-mode":"cors","sec-fetch-site":"same-origin","securitytenant":""},"remoteAddress":"XXX.XXX.XXX.XXX","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:122.0) Gecko/20100101 Firefox/122.0","referer":"https://XXX.XXX.XXX.XXX:5601/app/observability-metrics"},"res":{"statusCode":200,"responseTime":43,"contentLength":9},"message":"POST /api/ppl/search 200 43ms - 9.0B"}
{"type":"response","@timestamp":"2024-03-20T08:30:06Z","tags":[],"pid":124582,"method":"post","statusCode":200,"req":{"url":"/api/ppl/search","method":"post","headers":{"host":"XXX.XXX.XXX.XXX:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:122.0) Gecko/20100101 Firefox/122.0","accept":"*/*","accept-language":"de,en-US;q=0.7,en;q=0.3","accept-encoding":"gzip, deflate, br","referer":"https://XXX.XXX.XXX.XXX:5601/app/observability-metrics","content-type":"application/json","osd-version":"2.12.0","osd-xsrf":"osd-fetch","content-length":"109","origin":"https://XXX.XXX.XXX.XXX:5601","dnt":"1","sec-gpc":"1","connection":"keep-alive","sec-fetch-dest":"empty","sec-fetch-mode":"cors","sec-fetch-site":"same-origin","securitytenant":""},"remoteAddress":"XXX.XXX.XXX.XXX","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:122.0) Gecko/20100101 Firefox/122.0","referer":"https://XXX.XXX.XXX.XXX:5601/app/observability-metrics"},"res":{"statusCode":200,"responseTime":19,"contentLength":9},"message":"POST /api/ppl/search 200 19ms - 9.0B"}

Logs from opensearch:

[2024-03-20T08:31:18,283][INFO ][o.o.s.p.PPLService       ] [opensearch] [fc7f45a0-2b91-495a-a0b5-d6d789ef0e6e] Incoming request source=my_prometheus.query_range(***,***,***,***) | fields + null
[2024-03-20T08:31:18,292][INFO ][o.o.s.p.PPLService       ] [opensearch] [b77fd160-d4d5-455a-80a9-ad68dc66e615] Incoming request source=.DATASOURCES | where CONNECTOR_TYPE = *** | fields + DATASOURCE_NAME
[2024-03-20T08:31:18,300][INFO ][o.o.o.r.ObservabilityRestHandler] [opensearch] observability:executeGetRequest idList:[] types:[savedVisualization], from:0, maxItems:1000, sortField:null, sortOrder=null, filters={}
[2024-03-20T08:31:18,300][INFO ][o.o.o.a.ObservabilityActions] [opensearch] observability:ObservabilityObject-get []
[2024-03-20T08:31:18,301][INFO ][o.o.o.a.ObservabilityActions] [opensearch] observability:ObservabilityObject-getAll
[2024-03-20T08:31:18,302][INFO ][o.o.o.i.ObservabilityIndex] [opensearch] observability:getAllObservabilityObjects types:[savedVisualization] from:0, maxItems:1000, sortField:null, sortOrder=null, filters={} retCount:0, totalCount:0
[2024-03-20T08:31:18,428][INFO ][o.o.s.p.PPLService       ] [opensearch] [af149326-d623-49ee-bfae-8b3f62ee52b3] Incoming request source=my_prometheus.information_schema.tables | fields + null

I hope this will give you some insights. If you need other / more information, Iam happy to provide them.

Thanks a lot for your effort!

I did a fresh installation of the dashboard and created the data source from the opensearch-dashboard UI. During the creation I observed that we need to configure a master key. I modified the opensearch.yaml to include the master key as discribed in sql/docs/user/ppl/admin/datasources.rst at main · opensearch-project/sql · GitHub. This resolved the issue.

1 Like

I have the option plugins.query.datasources.encryption.masterkey already set in opensearch.yml.

Try to create the data source with the masterkey created from the opensearch dashboard UI. Also, reapply the opensearch.yaml changes on your cluster.

I’m having the same issue. Added the masterkey to opensearch.yml then recreated the datasource.

Also created a new datasource with the same endpoint and added every single role to it.

It flashes the metrics and then goes blank with the error:

SyntaxError: "[object Object]" is not valid JSON
    at JSON.parse (<anonymous>)
    at displayVisualization (observabilityDashboards.plugin.js:1633:114610)

This line in the code is the culprit, if I put a breakpoint there I can see that metaData.userConfigs is a javascript object, not a string.

metaData.userConfigs = JSON.parse(metaData.userConfigs)

If I override and remove the json.parse in chrome the sidebar shows up with all the metrics. I’m not sure why it won’t let me persist it because when I click one it seems to read the old source file again and blank out.

Seems like a bug. Created bug report: [BUG] [object Object] is not valid JSON · Issue #1665 · opensearch-project/dashboards-observability · GitHub

Hope this gets fixed soon in 2.14 else I will have to find an alternative to opensearch dashboard.